First Technology
Pioneering, Professional, Partners
Big Data Developer
Software EngineerSoftware EngineerFull TimeRemoteTeam 1,001-5,000Since 1983H1B SponsorCompany SiteLinkedIn
Location
United States
Posted
140 days ago
Salary
Not specified
Bachelor Degree4 yrs expEnglishAWSAzureCloudETLGoogle Cloud PlatformHadoopKafkaMap ReduceSpark
Job Description
• Analyze, refactor, and modernize Spark/MapReduce/Hive/Tez jobs for execution within NexusOne’s managed Spark and Trino environments.
• Design, build, and optimize batch and streaming pipelines using Spark, NiFi, and Kafka.
• Convert existing ETL jobs and DAGs from Cloudera/MAPR ecosystems to open-source equivalents.
• Collaborate with Data Engineers and Architects to define new data ingestion and transformation patterns.
• Tune performance across large-scale data processing workloads (partitioning, caching, resource allocation).
• Implement data quality and validation frameworks to ensure consistency during migration.
• Support code reviews, performance tests, and production readiness validation for migrated workloads.
• Document conversion approaches, dependencies, and operational runbooks.
• Partner with Wells Fargo application SMEs to ensure domain alignment and business continuity.
Job Requirements
- 4–8 years of experience in big data engineering or application modernization in enterprise settings.
- Prior experience with Cloudera, MAPR, or Hadoop ecosystems, transitioning to open-source frameworks.
- Strong understanding of distributed data architectures and data lake design principles.
- Exposure to hybrid or cloud-native environments (AWS, GCP, or Azure).
- Familiarity with regulated environments (financial services, telecom, healthcare) is a plus.
Related Guides
Related Job Pages
More Software Engineer Jobs
Power Apps Developer
People, Technology & Processes, LLCUsing technology to bridge the gap between people and processes.
Software Engineer140 days ago
Full TimeRemoteTeam 51-200Since 2010H1B No Sponsor
Power Apps Developer creating business rules and reports using Microsoft tools
Azure
Virginia
Application Developer
People, Technology & Processes, LLCUsing technology to bridge the gap between people and processes.
Software Engineer140 days ago
Full TimeRemoteTeam 51-200Since 2010H1B No Sponsor
Application Developer working with Microsoft 365 power applications
ASP.NETAzureSQL.NET
Virginia
Software Engineer140 days ago
ContractRemoteTeam 11-50Since 1996H1B No Sponsor
WordPress Developer Contractor handling project-specific development work
BootstrapJavaScriptPHPWordPress
United States
Windows Developer
SCATRThe data camouflage company delivering Zero Trust Transit for a post-quantum world
Software Engineer140 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor
Windows Developer designing and maintaining applications for SCATR’s security platform
CloudMS SQL ServerSQLWPF.NET
Ohio