Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteTeam 10,001+Since 1889H1B SponsorCompany SiteLinkedIn

Location

California

Posted

14 days ago

Salary

$129.3K - $172.3K / year

Bachelor Degree5 yrs expEnglishAirflowAmazon RedshiftApacheAWSAzureBig QueryCloudDockerHadoopKafkaKubernetesPythonSparkSQL

Job Description

• Build high-performing cloud data solutions to meet our analytical and BI reporting needs • Design, build, and operate secure, scalable cloud data pipelines that support analytics and data products • Integrate new data sources into the central data warehouse and deliver curated data to applications and other downstream destinations • Identify, design, and implement internal process improvements, such as automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability, etc. • Build and enhance a shared data lake that powers decision-making and model building • Implement data governance best practices across pipelines and datasets, including data quality checks, metadata management, lineage, and access controls • Partner with teams across the business to understand their needs and develop end-to-end data solutions • Collaborate with analysts to perform exploratory analysis and troubleshoot issues • Manage and model data using visualization tools to provide the company with a collaborative data analytics platform • Build tools and processes to help make the correct data accessible to the right people • Participate in active rotational support role for production during or after business hours supporting business continuity • Engage in collaboration and decision making with other engineers

Job Requirements

  • 5+ years of development experience with any of the following software languages: Python and SQL with cloud experience (Azure preferred or AWS)
  • Hands-on data security and cloud security methodologies.
  • Experience in configuration and management of data security to meet compliance and CISO security requirements
  • Experience creating and maintaining data intensive distributed solutions (especially involving data warehouse, data lake, data analytics) in a cloud environment
  • Hands-on experience in modern Data Analytics architectures encompassing data warehouse, data lake etc. designed and engineered in a cloud environment
  • Demonstrated experience applying data governance best practices, including data quality validation, cataloging/metadata, lineage, and role-based access controls
  • Hands-on expertise with LLMs and generative AI workflows.
  • Familiarity with AI governance and privacy-preserving techniques
  • Proven professional working experience in Event Streaming Platforms and data pipeline orchestration tools like Apache Kafka, Fivetran, Apache Airflow, or similar tools
  • Proven professional working experience in any of the following: Databricks, Snowflake, BigQuery, Spark in any flavor, HIVE, Hadoop, Cloudera or RedShift
  • Experience developing in a containerized local environment like Docker, Rancher, or Kubernetes preferred
  • Experience with or knowledge of Agile Software Development methodologies

Benefits

  • medical
  • dental
  • vision
  • 401k
  • PTO/paid sick leave
  • employee stock purchase plan

Related Categories

Related Job Pages

More Data Engineer Jobs

Senior Data Engineer

Digible, Inc

Digible provides advanced digital marketing and technology solutions for the multifamily housing industry.

Data Engineer15 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

Senior Data Engineer optimizing foundational data systems for Digible's software products

DockerPythonSQL
United States
$125K - $155K / year

Data Engineer

SunnyData

With a strong Data Engineering backbone, we deliver Databricks projects from concept to production.

Data Engineer15 days ago
Full TimeRemoteTeam 51-200

Data Engineer supporting customers with their data engineering needs.

AWSAzureCloudGoogle Cloud PlatformHadoopKafkaPandasScikit-LearnSparkSQL
United States

Data Engineer

GovWorx

AI That Elevates the Impact of ALL Responders

Data Engineer15 days ago
Full TimeRemoteTeam 11-50Since 2023

Data Engineer at GovWorx supporting AI solutions for public safety agencies

Amazon RedshiftAWSCloudDockerETLMySQLPandasPySparkPythonSQLTerraform
United States
$150K - $180K / year

Data Lake Architect II

arrivia

We’re a global powerhouse born from the merger of ICE, SOR Technology, and WMPH Vacations. We combine 55 years of stability with the agility of a tech innovator.

Data Engineer15 days ago
Full TimeRemote

At arrivia, we believe travel has the power to transform lives. To deliver world-class travel experiences to our millions of members, we need a world-class data foundation. We are looking for a Data Lake Architect II to be the visionary behind our next-generation cloud data platf...

AzureDatabricksSparkKafkaFlinkDelta LakeTerraformMLflowSynapseData LakeBig DataCI/CD
United States