BLue Sky Clarity Logo

Senior Data Engineer (Hadoop, SQL Server, Oracle, Teradata, Vertica, Netezz

Twitter Facebook
Burlington, MA
$100,000 - $130,000
Job Type
Direct Hire
Sep 07, 2018
Job ID
Senior Data Engineer (Hadoop, SQL Server, Oracle, Teradata, Vertica, Netezza), Burlington, MA
100k to 130k base, bonus Compensation Commensurate with experience, benefits, EOE, diverse culture
Candidates must be a U.S. citizen or national, refugee, asylum, or lawful permanent resident.

Our client is currently seeking a Senior Data Engineer with diverse experience with both SQL and NoSQL infrastructure, hopefully someone who has had the opportunity to work with Hadoop and additionally SQL Server or Oracle or Teradata or Vertica or Netezza.

  • Participate in migrations, development, enhancements and maintenance of product platform in a Data Warehouse/Data Analytics environment. 
  • Primarily focus on choosing optimal solutions to use for data infrastructure purposes, then designing, implementing them through coordination with application, infrastructure, and business teams. They will ensure data products and tool’s quality and consistency.
  • Work closely with Data Architect in migrating to Hadoop. Design and build multi-tenancy Data Warehouse for Analytics Solutions. Selecting and integrating Big Data tools and frameworks required to provide requested capabilities
  • Leverage your hands-on experience and knowledge with the following:
    1. Strong, set-based T-SQL programming skills and deep-dive knowledge of SQL internals
    2. Experience with SQL Server performance tuning and execution plans
    3. Strong understanding of DW concepts such as persistent staging, date packing, SLCD, map and reducing, time series objects
  • Implement efficient ETL and ELT processes for large data sets, preferably with market and trading data related providers
  • Build Big Data solutions using Hadoop and Spark or equivalent DW scale-out solutions
  • Create production solutions by leveraging your experience with public clouds such as Azure or AWS
  • Be detail-oriented and able to prioritize work and effectively manage multiple tasks
  • Use solid knowledge and experience with relevant programming languages and tools such as Scala, Python, unit test frameworks, CI/CD, and OOL (previous Java or C#)
  • Collaborate with business community to elicit, document and translate business requirements for Analytics solutions into technical requirements. Analyze complex data systems to develop automated and reusable solutions for extracting requested information while assuring data validity and integrity
  • Design, develop, deliver and support Analytics applications and solutions. Promote and support the infrastructure of reporting and Analytics strategy, including standards and best practices, advising any necessary infrastructure changes
  • Perform ongoing monitoring and refinement of Analytics tools and solutions. Design and implement solutions to deploy and upgrade new feature/functionality into existing product platform. Act as level 3 advanced support for field issues. Coordinate with technical community as needed
  • Bachelor’s degree in Computer Science or related field.
  • Experience with Data Warehousing. Proficient understanding of distributed computing principles. Proficiency with Hadoop, HDFS, SQL, Spark, Parquet, HBase and Impala. Experience with Clouder
  • Hands-on experience with at least one NoSQL database (e.g., MongoDB, Cassandra, HBase, CouchDB, BigTable, DynamoDB, CosmosDB)
  • Previous experience developing Data Warehouse:  creating data models, conformed dimensions and fact tables. Previous experience supporting a Data Warehouse, i.e. supporting implemented solutions, monitoring and tuning queries and data loads and addressing user questions
  • Ability to effectively articulate business and technical concepts. Experience working on building products. Experience with object-oriented languages: Java, Python, Scala, etc.
  • DW engineering experience, and at least 1 - 3 years hands-on experience with scale-out technologies
  • Must be result-oriented; takes commitments and deadlines seriously      Willing to work diligently and deliver solutions on schedule and within given budget parameters
  • Self-starter, able to work with minimal supervision and independently
  • Nice to have experience in:
  1. Complex time series and multi-dimensional data
  2. Micro service architectures
  3. Designing and building PaaS/DaaS data architecture and systems
  4. Financial industry knowledge
  5. Artificial intelligence (specifically machine-learning or deep-learning)
  6. Advanced degree in computers, math or science preferred
BlueSkyClarity (a Delaware LLC) is a search firm focused on retaining smart, passionate and talented people within the marketing, creative, analytic, product, sales, software engineering and information technology domain disciplines for web-to-consumer, digital agency, consulting, start-up, or iconic brand clients in all industries.
Posted by: