Spark Jobs

Refine Results
1 - 20 of 2,054 Jobs

Lead Data Engineer (Python, Spark, AWS)

Capital One

Chicago, Illinois, USA

Full-time

77 West Wacker Dr (35012), United States of America, Chicago, Illinois Lead Data Engineer (Python, Spark, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about m

Lead Back End Engineer (Python/Golang, ETL, SPARK, AWS)

Capital One

Chicago, Illinois, USA

Full-time

77 West Wacker Dr (35012), United States of America, Chicago, Illinois Lead Back End Engineer (Python/Golang, ETL, SPARK, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who love to solve real problems and meet real customer needs. We are seeking Back End Software

Senior Data Engineer - AWS, Scala, Spark

Strategic Staffing Solutions

Richmond, Virginia, USA

Contract

STRATEGIC STAFFING SOLUTIONS HAS AN OPENING! This is a Contract Opportunity with our company that MUST be worked on a W2 Only. No C2C eligibility for this position. Visa Sponsorship is Available! The details are below. Job Title: Senior Data Engineer - AWS, Scala, Spark Location: Richmond/ McLean, VA Hybrid work Contract Length: 4+ months Job ref# 236628 Job Description: Supporting Sunset Framework Requirements: Must have techs: Scala data pipelines, Spark engine, AWS & SQLNice to have: Jav

Lead Developer - Python / Spark

Eliassen Group

Pittsburgh, Pennsylvania, USA

Contract

Hybrid Role, applicants must be local to Pittsburgh PA. Our industry-leading financial services client is seeking a Lead Developer with Python and Spark experience to join their finance and regulatory team. We can facilitate w2 and corp-to-corp consultants. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance. J ob Responsibilities: Lead Developer provides application software development serv

ETL Engineer / Java Spark/ Ab Initio

ATR International, Inc.

Wilmington, Delaware, USA

Full-time

Job Description: We are seeking an ETL Engineer / Java Spark/ Ab Initio for a very important client. Requirement: Must have: Ab Initio exposure or knowledge is a MUST have, will be more flexible on AWS, Hadoop, Spark. Min 5 plus years of experience Experience with big data - preferably in a large complex organization Must have hands on ETL background and pipeline development. Must have Java background (We need core Java, not J2EE, the profile I rejected are advance Java and suited for UI base

Data Engineer with Strong Scala/Python and Spark

Techmatic Inc

Charlotte, North Carolina, USA

Contract

We are looking for a Data Engineer that will be responsible for designing and implementing data pipelines to efficiently load data from various sources into Google Cloud Platform (Google Cloud Platform). The ideal candidate will have a strong background in Spark and Scala/Python. While not required, the ideal candidate will also have exposure to SQL, Airflow, and Google Cloud Platform (DataProc, BQ). Key Responsibilities: - Design and develop data pipelines with Spark with Scala to ingest, trans

Spark Engineer

Maveric NXT Inc

Irving, Texas, USA

Full-time

Job Title: Spark Engineer Job Type Full Time Location- Irving, TX Experience: 4 - 9 Years Job Responsibilities: Designing, developing, and implementing scalable Spark-based applications for large-scale data processing.Optimizing Spark jobs for performance and efficiency, including tuning for memory management and caching.Integrating Spark with other Big Data technologies and frameworks such as Hadoop, Kafka, and Hive.Monitoring Spark jobs and clusters, diagnosing and resolving performance issues

Senior Data Engineer - Principal Associate (Spark, Scala, AWS)

Capital One

Chicago, Illinois, USA

Full-time

77 West Wacker Dr (35012), United States of America, Chicago, Illinois Senior Data Engineer - Principal Associate (Spark, Scala, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who

Java Spark Developer

LTIMindtree

Irving, Texas, USA

Full-time

Job Description: 7+ years of Experience in Java/J2EE, Big Data, Spark, Process Orchestration, (Architecture Low Level Design Experience).Strong experience in Core Java, Servlets, JavaScript, JMS, Spring, Hibernate.Strong experience with JUnit in writing test-cases and Experience in error logging and debuggingStrong experience in Spark, Core Java, Unix scripting, SparkSQL, Hive.Experience on Open Source Frameworks Spring MVC, Spring (Core, DAO, ORM), Hibernate, Maven.Experience in writing SQLs us

Lead Software Engineer (Spark, Scala and Azure)

Diligente Technologies

San Francisco, California, USA

Full-time

8-10 years of software development and deployment experience with at least 5 years of hands-on experience with Hadoop applications (e.g. administration, configuration management, monitoring, debugging, and performance tuning)Strong experience building data ingestion pipelines (simulating Extract, Transform, Load workload), data warehouse or database architectureHands-on development experience using open source big data components such as Hadoop, Hive, Pig, Spark, HBase, Hawk, Oozie, Mahout, Flum

Spark Developer

Amiseq Inc.

Remote

Contract

Spark Developer Remote 12 Months Contract We are working with a strategic customer and looking specifically for an individual with: Deep expertise when it comes to identifying and fixing bottlenecks in Spark jobs. This role will also require structured streaming expertise to build/optimize jobs. Please let us know if you can share a couple of profiles, we will be happy to review them asap! Identifying and Fixing Bottlenecks in Spark Jobs: Dive deep into Spark applications to identify perfor

Scala Spark Developer

CrackaJack Digital Solutions

Alpharetta, Georgia, USA

Contract

Self-starter who is proficient in development with Process Development, Headless REST APIs, JAVA, JEE, Spring, Git and other Frameworks with experience in guiding Project teams with full life cycle of development/design and requirements gathering Significant programming experience in a structured software development environment Build strategic generic tech solutions that can be reused and leveraged across business areas Possess framework mindset, in terms of building components/libraries tha

Google Cloud Platform Data Engineer (Hadoop/Spark/Python)

InfoVision, Inc.

Dallas, Texas, USA

Contract, Third Party

Job Title: Google Cloud Platform Data Engineer (Hadoop/Spark/Python) Location: Irving, TX Duration: Long-term Note: Hadoop/Spark/Python is a must-have skillset Job Description: 10+ Year of overall IT ExperienceBig data expert with 6+ years experience in Hadoop Big data ecosystemSpark - Batch & Streaming (Python, Scala )Apache Kafka hands on experienceExperience in cloud environment, specially Google Cloud PlatformExperience in developing both batch and real-time streaming data pipelinesPython/S

Java Spark Lead Developer

Hirekeyz

Mississauga, Ontario, Canada

Full-time

Role: Java Spark Lead Developer Location: Mississauga, ON (hybrid) Type: Full time Job Description: Position Overview: We are looking for a skilled Java Spark Lead Developer with hands-on experience in Java, Spark, Impala, Hive, and Hadoop. The ideal candidate will have a strong background in developing and leading Spark-based big data solutions. As a Java Spark Lead Developer, you will play a crucial role in designing, implementing, and optimizing high-performance data processing applications u

Java Spark Developer (12+ Years of experience- Only W2)

IRIS Software, Inc.

Tampa, Florida, USA

Contract

Greetings! One of our direct client(financial domain) is looking to hire Java Developer, This is long term contractual opportunity. Position: Java Spark Developer Duration: Long term contract Location: Tampa FL/ Irving TX and Mississauga ON (Hybrid) Responsibilities: Develop and maintain robust Java applications that integrate with Apache Spark for processing vast amounts of data efficiently and in real-time.Design, implement, and optimize Spark jobs and workflows to process structured and unst

Scala/Spark Developer

Xoriant Corporation

New York, New York, USA

Full-time

Title: Scala Developer (Scala, Hadoop & Spark) Duration: 12+ Months (Possible Extensions) Location: NYC, NY Client Industry: Financial Services Responsibilities will include: Understand and implement tactical or strategic solution for a given business problemDiscussion with stakeholders on business needs and technology requirements.Define and derive the strategic solutions as well as identify tactical solutions when necessary.Write technical design & other solution documents per Agile (SCRUM) s

Spark Developer with Scala/Python

Nityo Infotech Corporation

Sunnyvale, California, USA

Full-time

Job Role: Spark Developer with Scala/Python Job Location: Sunnyvale, CA or Ausin,TX Job Type: Full Time Job Description: In the role of Spark Developer with Scala/Python, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high

Spark Developer with Scala/Python

Infosys Technologies Ltd

Austin, Texas, USA

Full-time

In the role of Spark Developer with Scala/Python, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high quality code deliverables for a module, lead validation for all types of testing and support activities related to implem

Spark Developer with Java

Infosys Technologies Ltd

Irving, Texas, USA

Full-time

Infosys is seeking a Spark Developer with Java. In this role, you will enable digital transformation for our clients in a global delivery model, research on technologies independently, recommend appropriate solutions and support technology-specific best practices and standards. You will be responsible to collaborate with key partners and apply your technical proficiency across different stages of the Software Development Life Cycle. You will be part of a learning culture, where partnership and c

Python Spark Developer - C2C - Columbus, OH

Vy Systems

Columbus, Ohio, USA

Full-time

Hello Vendors, We do have openings for Python Spark Developer - C2C - Columbus, OH (Day 1 Onsite / Hybrid) Job Description: Duties and responsibilities Collaborate with the team to build out features for the data platform and consolidate dataassets Build, maintain and optimize data pipelines built using Spark Advise, consult, and coach other data professionals on standards and practices Work with the team to define company data assets Migrate CMS data platform into Chase s environment Partne