| Spark Developer Exp 11@Plano, TX (Onsite) at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2297951&uid= Hi Contract Role: Spark Developer Exp 11 Location: Plano, TX (Onsite) Rate: 50 Max Must have: Spark Databricks AWS Strong programming skills in Java, Scala, or Python Familiarity with big data processing tools and techniques Experience with the Hadoop ecosystem Job Description: Develop and maintain data pipelines using Apache Spark and Scala to process large volumes of data efficiently. Implement data transformation logic to cleanse, normalise, and aggregate data from various sources, ensuring high data quality and consistency. Integrate data from different systems and sources, including structured and unstructured data, databases, and Mainframe systems, ensuring seamless data flow and compatibility. Implement data validation and quality checks within data pipelines to ensure data accuracy, consistency, and integrity, and handle exception handling and error logging. Develop and execute unit tests, integration tests, and end-to-end tests to ensure the reliability and correctness of Spark applications. Debug and troubleshoot issues during development and production phases. Contribute to the overall DevOps for SBT builds, application deployment stages and releases. Designing, Implementing, and maintain Continuous Integration and Continuous Deployment pipelines. Automate/Optimise the build, test, and deployment processes to enable rapid and reliable software delivery. Collaborate with Walmart cross-functional teams, including Product managers, Architects, and other developers, to understand data requirements and deliver optimal solutions. Document data engineering processes, data flows, and technical specifications. Keep up-to-date with the latest advancements in Spark, Scala, and related technologies, frameworks, and tools. Continuously improve skills and knowledge through self-learning and professional development. Additional Sills: Develop, program, and maintain applications using the Apache Spark opensource frameworkWork with different aspects of the Spark ecosystem, including Spark SQL, DataFrames, Datasets, and streamingSpark Developer must have strong programming skills in Java, Scala, or PythonFamiliar with big data processing tools and techniques Passport Numb is Mandatory / /// - Visa O nly Thanks & regards Acharya Mail: [email protected] -- Keywords: information technology Texas Spark Developer Exp 11@Plano, TX (Onsite) [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2297951&uid= |
| [email protected] View All |
| 10:43 PM 28-Mar-25 |