Job DescriptionDescriptionJob Title Big Data Apps DeveloperDescription The primary role for this developer will be to audit existing ETL scripts in Spark API, develop a framework to identify long running/low performing scripts, debug and improve those scripts, and train the existing ETL team on pitfalls and best practices to eliminate and prevent recurrence of low performing ETL scripts in the future. All phases of software engineering including requirements analysis, application design and code development and testing Designing and implementing product features in collaboration with business and IT stakeholders Designing reusable frameworks, libraries and components Working very closely with Architecture group and driving technical solutions Lead technology decisions, drive product implementation and delivery Troubleshooting production support issues post-deployment and come up with solutions as required Demonstrate substantial depth of knowledge and experience in a specific area of Big Data and Java/Scala development Unix, Java, SQL Big Data Technologies (Spark, Scala, Python, ML Libraries, Elastic Search, Hbase, Hive, SQL, MapR, Talend) Agile/Scrum methodology Experience 8+ years software engineering 5+ years hands on expertise with Unix, Java, SQL 3+ years Big data technologies #Low #Horizontal Integration is proud to be an Equal Opportunity and Affirmative Action Employer. We seek to provide employment opportunities to talented, qualified employees and candidates regardless of race, color, sex/gender including gender identity and/or expression, national origin, religion, sexual orientation, disability, marital status, citizen status, veteran status and /or any other protected class as identified under federal,state or local statute. In addition, Horizontal Integration will provide reasonable accommodations for qualified individuals with disabilities. If you need to request a reasonable accommodation in order to complete the application or interview process, please contact firstname.lastname@example.org. All applicants applying must be legally authorized to work in the country of employment.