Job DescriptionAt Perficient youll deliver mission-critical technology and business solutions to Fortune 500 companies and some of the most recognized brands on the planet. And youll do it with cutting-edge technologies, thanks to our close partnerships with the worlds biggest vendors. Our network of offices across North America, as well as locations in India and China, will give you the opportunity to spread your wings, too. Were proud to be publicly recognized as a Top Workplace year after year. This is due, in no small part, to our entrepreneurial attitude and collaborative spirit that sets us apart and keeps our colleagues impassioned, driven, and fulfilled. Perficient Data Solutions is looking for an experienced Senior Big Data/Hadoop Developer . This is a national position that can be located in any well connected city. Perficient is on a mission to help enterprises take advantage of modern data and analytics architectures, tools, and patterns to improve the business operations and better engage customers. This is an excellent opportunity for the right individual to assist Perficient and its customers to grow the capabilities necessary to improve care through better use of data and information, and in the process take their career to the next level. As a Senior Big Data Developer you will participate in all aspects of the software development lifecycle which includes estimating, technical design, implementation, documentation, testing, deployment and support of application developed for our clients. As a member working in a team environment you will take direction from solution architects and Leads on development activities. Responsibilities Responsibilities Create data integration pipelines to extract, cleanse, and integrate data from a variety of sources and formats for analysis and use across use cases. Perform data profiling, discovery, and analysis to identify/determine location, suitability and coverage of data, and identify the various data types, formats, and data quality which exist within a given data source. Work with source system and business SMEs to develop an understanding of the data requirements and options available within customer sources to meet the data and business requirements. Create re-usable data extraction/ingestion pipelines and templates to demonstrate the logical flow and manipulation of data required to move data from customer source systems into the target data lake, warehouse, and/or sandbox. Perform hands on data development to build the data extraction, movement and integration, leveraging state of the art tools and practices, including both streaming and batched data ingestion techniques. Provide elbow-to-elbow style mentoring of customer resources and other consultants. Assist in creation of data requirements and data model design as necessary and appropriate. Qualifications Qualifications Minimum of 3 years of experience working with the Apache Hadoop Ecosystem of tools and technologies to extract, integrate, cleanse and organize data, including experience with either the Hortonworks or Cloudera distributions. Key Tools and Technologies Spark Scala Python Java Experience working with the following types of workloads and data pipelines: Enterprise-scale ETL and ELT batched workloads Near real-time micro-batches Streaming data Experience working with Data Governance frameworks Some experience performing conceptual and logical data model design Experience in the Financial Services, Retail industry, or Healthcare Payor or Provider industries is a plus. Strong NoSQL, SparkSQL, and ANSI SQL query language skills Strong verbal and written communication and English language skills Strong consulting skills, consulting experience strongly desired Perficient full-time employees receive complete and competitive benefits. We offer a collaborative work environment, competitive compensation, generous work/life opportunities and an outstanding benefits package that includes paid time off plus holidays. In addition, all colleagues are eligible for a number of rewards and recognition programs including billable bonus opportunities. Encouraging a healthy work/life balance and providing our colleagues great benefits are just part of what makes Perficient a great place to work. More About Perficient Perficient is the leading digital transformation consulting firm serving Global 2000 and enterprise customers throughout North America. With unparalleled information technology, management consulting and creative capabilities, Perficient and its Perficient Digital agency deliver vision, execution and value with outstanding digital experience, business optimization and industry solutions. Our work enables clients to improve productivity and competitiveness; grow and strengthen relationships with customers, suppliers and partners; and reduce costs. Perficient's professionals serve clients from a network of offices across North America and offshore locations in India and China. Traded on the Nasdaq Global Select Market, Perficient is a member of the Russell 2000 index and the S&P SmallCap 600 index. Perficient is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national, origin, disability status, protected veteran status, or any other characteristic protected by law. Disclaimer: The above statements are not intended to be a complete statement of job content, rather to act as a guide to the essential functions performed by the employee assigned to this classification. Management retains the discretion to add or change the duties of the position at any time. Select work authorization questions to ask when applicants apply Are you legally authorized to work in the United States? Will you now, or in the future, require sponsorship for employment visa status (e.g. H-1B visa status)?