Data Engineer II, Data Products
Crane Worldwide Logistics · Houston, Texas, US
ESSENTIAL JOB FUNCTIONS Data Pipeline & Platform Development - Build and maintain pipelines using dbt, Prefect, and Terraform - Develop and manage connectors...
Job description
ESSENTIAL JOB FUNCTIONS: Data Pipeline & Platform Development: - Build and maintain pipelines using dbt, Prefect, and Terraform - Develop and manage connectors across sources and targets including Kafka, RDBMs, and Snowflake. - Implement schema evolution, validation rules, and automated testing - Support high-availability and disaster recovery design for Snowflake and Materialize Data Product Engineering: - Author and review schemas and data contracts for consistency and governance - Develop and optimize dbt models for Snowflake and Materialize analytics layers - Configure clusters and role-based access for shared environments - Document datasets to ensure discoverability and proper usage across teams Stakeholder Collaboration: - Partner with BI developers, analysts, and business teams to deliver datasets that support reporting, dashboards, and integrations - Investigate and resolve data issues, ensuring durable fixes - Participate in design reviews to align technical solutions with business requirements Collaboration & Standards: - Contribute to PR and design reviews for pipelines and models - Support platform governance, observability, and best practices for data quality - Work w...