LivantaLLC
Advancing healthcare quality through innovation
Senior Data Engineer
Location
United States
Posted
29 days ago
Salary
$100K - $130K / year
Bachelor Degree4 yrs expEnglishAirflowAmazon RedshiftApacheAWSCloudETLKubernetesMongo DBNo SQLPostgresPythonScalaSparkSQL
Job Description
• Responsible for designing, building, and maintaining efficient, scalable, and fully automated data pipelines and architectures that support various business needs
• Design, develop, and maintain scalable data pipelines to collect, process, and transform data from various sources
• Integrate data from multiple sources, ensuring data quality and consistency across the organization
• Build and maintain data storage solutions, including data warehouses and data lakes, ensuring optimal performance and reliability
• Implement data transformation and enrichment processes to prepare data for analytics and reporting
• Leverage cloud technologies, particularly AWS, to optimize and manage data infrastructure
• Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions
• Create and maintain comprehensive documentation for data pipelines, data models, and related processes
• Mentor and guide junior data engineers/analysts on data engineering best practices and industry standards
Job Requirements
- Minimum of 4 years of experience in data engineering or a related field
- Strong experience with data pipeline/orchestration and ETL development using tools such as Apache Airflow, Kubernetes, Databricks Workflows or similar
- Demonstrated experience in designing highly efficient programs capable of processing terabytes of data
- Strong proficiency in SQL and experience with relational databases (e.g., SQLServer, PostgreSQL) and NoSQL databases (e.g., MongoDB, OpenSearch)
- Experience with cloud technologies, particularly AWS (e.g., S3, Redshift, Glue, Lambda, Athena)
- Proficient in writing data programs in R, Python, Scala, or similar language
- Familiarity with big data technologies such as Apache Spark, Databricks, or similar
- Familiarity with data visualization tools and data migration methods
- Excellent problem-solving skills and attention to detail
- Strong communication and interpersonal skills, with the ability to work effectively with diverse teams and stakeholders
Benefits
- Equal employment opportunities
- Reasonable accommodation for disabilities
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer29 days ago
InternshipRemoteTeam 5,001-10,000H1B No Sponsor
Data Engineering Intern developing software solutions in a healthcare technology company
AzureCloudETL
United States
Data Engineer30 days ago
Full TimeRemoteTeam 10,001+Since 1961H1B Sponsor
Lead Data Engineer designing and maintaining data processing architectures for Humana
AWSAzureCloudDockerJUnitKafkaKubernetesOraclePythonSeleniumSQL
Data Engineer
GuidehouseSolving big problems, building trust in society, and empowering our clients to shape the future.
Data Engineer30 days ago
Full TimeRemoteTeam 10,001+Since 2018H1B Sponsor
Data Engineer focusing on military clients in the Defense & Security segment
AWSAzureCloudETLPythonSparkSQL
AWS Data Architect – Cloud Consultant
Vertical RelevanceYour trusted Financial Services industry partner in Business Transformation, Customer Experience, & AWS Cloud Services.
Data Engineer30 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor
AWS Data Architect / Consultant responsible for planning and deploying software systems
Amazon RedshiftApacheAWSCloudRedisTerraform
United States