Data Engineer - Pipelines and Platform
About the position Position at Parts Town See What We’re All About As the fastest-growing distributor of restaurant equipment, HVAC and residential appliance parts, we like to do things a little differently. First, you need to understand and demonstrate our Core Values with safety being your first priority. That’s key. But we’re also looking for unique enthusiasm, high integrity, courage to embrace change…and if you know a few jokes, that puts you on the top of our list! Do you have a genius-level knowledge of original equipment manufacturer parts? If not, no problem! We’re more interested in passionate people with fresh ideas from different backgrounds. That’s what keeps us at the top of our game. We’re proud that our workplace has been recognized for its growth and innovation on the Inc. 5000 list 15 years in a row and the Crain’s Fast 50 list ten times. We are honored to be voted by our Chicagoland team as a Chicago Tribune Top Workplace for the last four years. If you’re ready to roll up your sleeves, go above and beyond and put your ambition to work, all while having some fun, let’s chat – Apply Today! Perks Parts Town Pride – check out our virtual tour and culture! Quarterly profit-sharing bonus Hybrid work schedule Team member appreciation events and recognition programs Volunteer opportunities Monthly IT stipend Casual dress code On-demand pay options: Access your pay as you earn it, to cover unexpected or even everyday expenses All the traditional benefits like health insurance, 401k/401k match, employee assistance programs and time away – don’t worry, we’ve got you covered. The Job at a Glance We are looking for a Data Engineer- Pipelines & Platform that will focus on building and maintaining reliable, scalable pipelines on our Google Cloud Platform (GCP) data ecosystem. They will ensure data from SAP, Salesforce, eCommerce, WMS, and other systems flows seamlessly into BigQuery through automated, monitored, and secure processes. Y ou will play a pivotal and foundational role in shaping our data driven and AI mission by building the pipelines, products, and platforms that power the next generation of digital distribution. Responsibilities • Design, build, and maintain ETL/ELT pipelines on GCP using Dataflow, Dataproc , or Cloud Data Fusion. • Manage workflow orchestration with Cloud Composer (Airflow) for scheduling, retries, and monitoring. • Optimize data ingestion from SAP, Salesforce, eCommerce, and WMS into BigQuery . • Implement Pub/Sub streaming pipelines for near real-time use cases. • Develop and manage bronze/silver layers (raw + cleansed) with best practices for schema design and partitioning. • Implement data quality frameworks (Great Expectations, dbt tests, or custom Python checks) with automated alerts. • Automate CI/CD for data pipelines using Cloud Build or GitHub Actions. • Monitor cost/performance of pipelines with Cloud Monitoring & Logging. • Document pipeline architecture and maintain data lineage via Dataplex or Collibra integration. Requirements • You have 4+ years of experience in data engineering, ideally with GCP as the primary cloud. • You obtain d eep expertise with BigQuery , Dataflow, Cloud Composer, and Pub/Sub. • You’re proficie nt in SQL and Python. • You have h ands-on experience with dbt for data transformations. • You’re familiar with Terraform (or Deployment Manager) for IaC . • You have e xperience designing scalable ingestion frameworks from ERP/CRM/WMS/eCommerce. • You have st rong knowledge of security, IAM, and compliance in cloud data environments. • You’re an all-star communicator and are proficient in English (both written and verbal) • You have a quality, high speed internet connection at home Benefits • Parts Town Pride – check out our virtual tour and culture! • Quarterly profit-sharing bonus • Hybrid work schedule • Team member appreciation events and recognition programs • Volunteer opportunities • Monthly IT stipend • Casual dress code • On-demand pay options: Access your pay as you earn it, to cover unexpected or even everyday expenses • All the traditional benefits like health insurance, 401k/401k match, employee assistance programs and time away – don’t worry, we’ve got you covered. Apply tot his job