Senior Software Engineer, Metadata
dbt Labs
Remote job description
About Us
dbt Labs was founded in 2016 to empower analysts to create and disseminate organizational knowledge. Since then, we've grown to become one of the leading brands in the analytics industry. Our product, dbt, is used by thousands of companies. dbt Labs is a remote-first, values-driven company with a globally distributed team. You can learn more about our values here.
The dbt Cloud platform is seeing tremendous growth! As the number of runs increases dramatically month over month, we produce an ever-increasing amount of metadata (Like a lot - the metadata team oversees the largest database at dbt Labs)! Ingesting and storing metadata (data about our users' datasets) is a critical production service, and over the next several quarters, our team's focus is to design the architecture to drive the resiliency, availability, scalability and performance of our metadata ingestion pipeline and user-facing API. The goal is to be able to confidently sustain dramatic usage growth over the next several years, and we'll know we've been successful when we achieve horizontal scalability and improve service reliability and observability without impacting service availability and performance.
Doing this will require varied work: research, development, debugging, consultation, collaboration. This role has a tremendous opportunity to influence not only how we scale our metadata storage and systems, but the methods and processes we use to manage scale and stability of our many services across dbt Labs.
At dbt Labs, we have developed strong opinions on how companies should practice analytics.
Specifically, we believe that:
- Code, not graphical user interfaces, is the best abstraction to express complex analytic logic
- Data analysts should adopt similar practices and tools to software developers
- Critical analytics infrastructure should be controlled by its users as open source software
- Analytic code itself?-?not just analytics tools?-?will increasingly be open source
It turns out that a lot of other people believe this too! Today, there are 9,000 companies using dbt every week, 30,000 practitioners in the dbt Community Slack, and 1,800 companies paying for dbt Cloud. Our customers include JetBlue, Hubspot, Vodafone New Zealand, and Dunelm. dbt is synonymous with the practice of analytics engineering, defining an entire industry. We're backed by top investors including Andreessen Horowitz, Sequoia Capital, and Altimeter. We recently raised our series D: read the announcement here!
dbt Labs is an equal opportunity employer. We're committed to building an inclusive team that welcomes a diversity of perspectives, people, and backgrounds regardless of race, color, national origin, gender, sexual orientation, age, religion, disability, citizenship, veteran status, or any other protected status. We feel strongly that whether or not your experience exactly fits the job description, your passion and skills will stand out and set you apart even if your career has taken some twists and turns. If you are on the fence about whether you meet our requirements, we encourage you to apply anyway! Please reach out to us directly at recruiting@dbtlabs.com if you need assistance or accommodation due to disability.
Want to learn more about our focus on Diversity, Equity and Inclusion at dbt Labs? Check out our DEI page here.
dbt Labs reserves the right to amend or withdraw the posting at any time.
#LI-Remote
Summary
Company name: dbt Labs
Remote job title: Senior Software Engineer, Metadata
Job tags: Python, databases, query optimization
dbt Labs was founded in 2016 to empower analysts to create and disseminate organizational knowledge. Since then, we've grown to become one of the leading brands in the analytics industry. Our product, dbt, is used by thousands of companies. dbt Labs is a remote-first, values-driven company with a globally distributed team. You can learn more about our values here.
The dbt Cloud platform is seeing tremendous growth! As the number of runs increases dramatically month over month, we produce an ever-increasing amount of metadata (Like a lot - the metadata team oversees the largest database at dbt Labs)! Ingesting and storing metadata (data about our users' datasets) is a critical production service, and over the next several quarters, our team's focus is to design the architecture to drive the resiliency, availability, scalability and performance of our metadata ingestion pipeline and user-facing API. The goal is to be able to confidently sustain dramatic usage growth over the next several years, and we'll know we've been successful when we achieve horizontal scalability and improve service reliability and observability without impacting service availability and performance.
Doing this will require varied work: research, development, debugging, consultation, collaboration. This role has a tremendous opportunity to influence not only how we scale our metadata storage and systems, but the methods and processes we use to manage scale and stability of our many services across dbt Labs.
In this role you can expect to:
- Collaborate within the metadata team to debug, develop, and improve the scale and performance of our metadata ingestion and API
- Partner with other teams to improve integrations and release processes of the dbt Cloud product and infrastructure
- Leverage your experience to establish and drive standards and best practices for large-scale storage across our platform
- Identify, investigate, and remedy performance and scalability limitations for metadata ingestion and our API
- Work with variety of programming languages, systems, and technologies, including: Python, Go, Postgres, Kubernetes, and AWS
You are a good fit if you have:
- Have 5+ years experience as a software engineer
- Minimum requirement of Bachelors degree in related field (computer science, computer engineering, etc.) OR
- Completed enrollment in engineering related bootcamp
- Scaled a large SaaS application, especially leveraging Python/Django, Kubernetes, and AWS
- Participated in support of a critical production service with a large datastore
- Dived deeply into query optimization and relational database performance (we use PostgreSQL in some... interesting... ways)
- Successfully navigated tradeoffs to ship useful features today without sacrificing long-term quality
- Worked asynchronously as part of a fully-remote, distributed team
You'll have an edge if you have:
- Considerable experience with multiple storage solutions for large data applications
- Debugged critical production incidents as a Software or Site Reliability Engineer
- Been successful working within a remote-first company culture Compensation and Benefits:
- Salary: $154,000-$200,000
- Equity Stake
- Benefits: In the US, dbt Labs offers unlimited vacation (and yes we use it!), 401k w/3% guaranteed contribution, excellent healthcare, paid parental leave and a home office stipend. For employees outside the United States, dbt Labs offers a competitive benefits package.
- Equity or comparable benefits may be offered depending on the legal limitations What to expect in the hiring process:
- An introductory call with a Talent Acquisition Partner
- A technical screen and meeting with our Engineering Manager
- Panel interviews including multiple members of the Engineering Team
- A final interview with a member of our Senior Leadership team
At dbt Labs, we have developed strong opinions on how companies should practice analytics.
Specifically, we believe that:
- Code, not graphical user interfaces, is the best abstraction to express complex analytic logic
- Data analysts should adopt similar practices and tools to software developers
- Critical analytics infrastructure should be controlled by its users as open source software
- Analytic code itself?-?not just analytics tools?-?will increasingly be open source
It turns out that a lot of other people believe this too! Today, there are 9,000 companies using dbt every week, 30,000 practitioners in the dbt Community Slack, and 1,800 companies paying for dbt Cloud. Our customers include JetBlue, Hubspot, Vodafone New Zealand, and Dunelm. dbt is synonymous with the practice of analytics engineering, defining an entire industry. We're backed by top investors including Andreessen Horowitz, Sequoia Capital, and Altimeter. We recently raised our series D: read the announcement here!
dbt Labs is an equal opportunity employer. We're committed to building an inclusive team that welcomes a diversity of perspectives, people, and backgrounds regardless of race, color, national origin, gender, sexual orientation, age, religion, disability, citizenship, veteran status, or any other protected status. We feel strongly that whether or not your experience exactly fits the job description, your passion and skills will stand out and set you apart even if your career has taken some twists and turns. If you are on the fence about whether you meet our requirements, we encourage you to apply anyway! Please reach out to us directly at recruiting@dbtlabs.com if you need assistance or accommodation due to disability.
Want to learn more about our focus on Diversity, Equity and Inclusion at dbt Labs? Check out our DEI page here.
dbt Labs reserves the right to amend or withdraw the posting at any time.
#LI-Remote
Summary
Company name: dbt Labs
Remote job title: Senior Software Engineer, Metadata
Job tags: Python, databases, query optimization
-
location or timezone
-
category
Software Development -
posted
591 days ago
United Stateshttps://www.remote.io/remote-software-development-jobs/senior-software-engineer-metadata-36040