Senior Big Data Engineer

• What you will do

• Analyze, develop and implement database designs, data models and logical data specifications
• Review and improve existing databases/data warehouse designs
• Contribute to systems architecture analysis and designProvide comprehensive consultation to infrastructure administrators and business analysts in resolving issues
• Perform data modeling studies and develop detailed data models
• Work with Business Analysts and staff to establish and maintain consistent data element definitions
• Participate in the development and maintenance of corporate data architecture, data management standards and conventions, data dictionaries and data element naming standards
• Research and evaluate alternative solutions and recommend the most efficient and cost effective data related solutions for improved data integrity
• Performance tune ETL jobs and data models
• Migrate ETL code from development to production environments
• Assist in the design and development of BI dashboards
• Perform DW training as needed

• Must haves

• Bachelor’s degree in a technical field such as computer science, computer engineering or related field required
• 5-7 years experience required
• Experience with ETL tools such as Informatics
• Strong BI Analytics concepts experience
• Experience with BI modeling tools such as Oracle OBIEE Repository(RPD) and IBM Cognos Framework Manager
• Experience in creating dashboards and reports
• Strong data analysis and data profiling skills
• Strong database management skills Oral, written and interpersonal communication skills; Organizational and prioritization skills; Analytical and problem-solving skills
• Experience in AWS cloud services.
• Must be working in big data projects with 4+ years of experience
• Strong working experience Apache Spark
• Good experience programming language Scala or Java or both

In the Market Regulation Surveillance Patterns technology team, an expert in this role is vested with responsibilities arising from FINRA’s mission to protect the integrity of US Securities Capital markets. FINRA has a portfolio of ‘surveillance patterns’ that look for manipulative and non-compliant behavior in the database of all transactions that occur in the stock market. The database itself consists of tens of billions of records per day. Engineers work with these large volumes of data using state-of-the-art and industry standard technologies, all of which are wholly operated in a cloud computing environment. In order to operate with ever-improving effectiveness, the team operates in a rich culture of performance and innovation. Collaboration within the team and with business stakeholders is frictionless, with significant independence offered in order to experiment with better ways of conducting technology for business value. Technological and career growth opportunities are a natural and everyday part of the working environment.