Job Description

At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective Industries. if your passion for data analytics solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering! 🔮🌐
What It's Like to Work at 3Pillar:
At 3Pillar, we create an environment where people can do their best work while maintaining a healthy work-life balance.
  • Flexibility & Well-being – Our remote-first approach gives you the flexibility to work where you perform best, while prioritizing your well-being and personal commitments.
  • Global Community – Collaborate with talented colleagues across the globe in a culture built on connection, support, and shared success.
  • Your Voice Matters – We foster open communication and multiple feedback channels, ensuring every employee has the opportunity to be heard and make an impact.
  • Growth & Development – Gain exposure to diverse clients, industries, and challenges that accelerate learning and career growth.

Our culture is guided by four core values: Collaboration, Outperform, Respect, and Evolve—the principles that shape how we work, grow, and succeed together.
Key Responsibilities
  • Design, develop, and optimize scalable ETL/ELT pipelines for enterprise data platforms
  • Build and maintain robust data solutions using Snowflake, Python, and AWS services
  • Develop advanced SQL queries using CTEs, window functions, query tuning, and performance optimization techniques
  • Work with Snowflake warehouses, tasks, streams, and data pipelines for efficient data processing
  • Create and maintain data transformation workflows using dbt (data build tool)
  • Develop reporting datasets and support dashboarding solutions using Amazon QuickSight
  • Perform data validation, data integrity checks, and root cause analysis to ensure data accuracy and reliability
  • Integrate and manage data across platforms including DynamoDB, S3, AWS Glue, Lambda, and Rockset
  • Collaborate with cross-functional teams including analytics, product, and clinical stakeholders to support reporting requirements
  • Monitor pipeline performance and troubleshoot production data issues
    • Required Skills
  • Strong experience in SQL including:
    • CTEs
    • Window Functions
    • Query Optimization
    • Performance Tuning
    • Hands-on experience with Snowflake:
      • Warehouses
      • Streams
      • Tasks
      • Data Loading and Optimization
      • Experience in Python for data processing and pipeline development
      • Experience with AWS services:
        • AWS Glue
        • Lambda
        • S3
        • Good knowledge of dbt (Data Build Tool)
        • Experience in creating dashboards and reports using Amazon QuickSight
        • Knowledge of Rockset analytical engine
        • Experience with DynamoDB and NoSQL databases
        • Basic to intermediate knowledge of JavaScript