Sr. Data Engineer

Who We Are:

At Bandwidth, your music matters when you are part of the BAND. We celebrate differences and encourage BANDmates to be their authentic selves. #jointheband

What We Are Looking For:

This role focuses on designing, building, and optimizing scalable data platforms that enable data ingestion, transformation, and governance for the organization. The Sr. Data Engineer will work closely with cross-functional teams to support both traditional data engineering pipelines and modern data mesh initiatives, balancing infrastructure development, data-ops, and enablement. The role requires a strong understanding of data architecture in Snowflake, along with proficiency in Python, AWS services, and dev-ops practices, to drive efficient data solutions for enterprise-wide data consumption.

What You'll Do:

• Develop and Maintain Scalable Data Platforms: Lead the design and development of scalable, secure, and efficient data platforms using Snowflake and other cloud technologies, ensuring alignment with the organization's data mesh and platform enablement goals.
• Build and Optimize Data Pipelines: Architect, build, and optimize ETL/ELT data pipelines to support various business units, balancing batch and streaming solutions. Leverage tools like AWS DMS, RDS, S3, and Kafka to ensure smooth data flows.
• Data Enablement & Ops: Collaborate with cross-functional teams (data engineers, data scientists, analysts, and architects) to create data-as-a-product offerings, ensuring self-service enablement, observability, and data quality.
• Automation & CI/CD: Develop, manage, and continuously improve automated data pipelines using Python (Prefect) and cloud-native services (AWS). Ensure CI/CD pipelines are set up for efficient deployment and monitoring.
• Snowflake Expertise: Apply deep knowledge of Snowflake SQL to build efficient and performant data models, optimizing storage and query performance.
• Cloud Data Integration: Use AWS services and data integration tools (DMS, Prefect) to ingest and manage diverse data sets across the organization.
• Data Governance & Compliance: Work closely with solution architects to implement data governance frameworks, ensuring adherence to enterprise data standards and regulatory compliance.
• Stakeholder Collaboration: Partner with product owners, business stakeholders, and data teams to translate business requirements into scalable data solutions, aligning roadmaps with organizational objectives.
• Agile Practices & Leadership: Participate in Agile ceremonies, mentor junior engineers, and help drive a culture of continuous improvement across the data engineering team.
• Metrics and Observability: Implement monitoring and metrics for data pipeline health, performance, and data quality, driving insights to improve product decision-making.

What You Need:

Education:

• Bachelor's degree (within an engineering or computer science discipline strongly preferred) or equivalent work experience

Experience:

• 8+ years of experience working in software architecture in the data engineering domain.
• Demonstrated track record of operating in highly collaborative, flexible, and productive cross-organization teams.
• Proven ability to perform in high-visibility, high-growth environments.
• Action and results-oriented, able to communicate strategies and tactics, identify obstacles.
• Experience in providing effective leadership to developers/engineers through the creation of Agile backlog assets and ongoing day-to-day guidance, resulting in development outcomes steeped in productivity and fun.

Knowledge:

• Programming Languages, e.g. Python, Java
• SQL Databases, e.g. MySQL, PostgreSQL, SQL Server, MariaDB
• NoSQL Databases, e.g. MongoDB, Cassandra
• Data Warehousing Solutions, e.g. Snowflake
• Data Processing, e.g. Flink
• Stream Process, e.g. Kafka, MSK
• Data modeling, ETL/ELT processes, and data quality frameworks.
• Other data engineering tools, e.g. Kafka Connect, DMS, Talend, Prefect
• Cloud Platforms, e.g. AWS
• Containerization/Orchestration, e.g. Kubernetes (k8s)
• CI/CD tools, Version control tools: ArgoCD, Github, Github actions
• Agile methodologies and frameworks, e.g. Scrum, Kanban
• Collaboration tools, e.g. JIRA, Monday

Skills:

• Demonstrated skills in developing products and/or solutions with a focus on agile principles working with internal delivery teams.
• Strong written and verbal communication.

Bonus Points:

Education:

• SnowPro Advanced Certification or equivalent certification.

Experience:

• Working in Prefect or building other Python-based ETL pipelines
• Building and maintaining DevOps/DataOps workflows
• Implementing observability, monitoring and alerting against data feeds and products

Knowledge:

• Data governance frameworks and compliance standards.
• Enterprise data architecture or solution architecture.

The Whole Person Promise:

At Bandwidth, we're pretty proud of our corporate culture, which is rooted in our "Whole Person Promise." We promise all employees that they can have meaningful work AND a full life, and we provide a work environment geared toward enriching your body, mind, and spirit. How do we do that? Well

• 100% company-paid Medical, Vision, & Dental coverage for you and your family with low deductibles and low out-of-pocket expenses.
• All new hires receive four weeks of PTO.
• PTO Embargo. When you take time off (of any kind!) you're embargoed from working. Bandmates and managers are not allowed to interrupt your PTO not even with email.
• Additional PTO can be earned throughout the year through volunteer hours and Bandwidth challenges.
• "Mahalo moments" program grants additional time off for life's most important moments like graduations, buying a first home, getting married, wedding anniversaries (every five years), and the birth of a grandchild.
• 90-Minute Workout Lunches and unlimited meetings with our very own nutritionist.