Senior Big Data Engineer

Mountain View, California, United States Full-time Allows remote

Who we are

TOTVS Labs is looking for a Senior Big Data Engineer to work on Carol - our Data & Machine Learning Platform (www.carol.com).

Carol is already being used by several companies in different industries, e.g., Education, Manufacturing, Retail, Healthcare, and Agribusiness. We are bringing Data & Machine Learning for all, come and join us!


As a Senior Data Engineer at TOTVS Labs you will:

  • Build and maintain a large-scale and highly-available Big Data infrastructure
  • Support a high volume of data which is growing exponentially
  • Orchestrating streaming data flow to fast accepting IOT data inputs and make data available for both distributed processing system as well as online real-time system
  • Provide support for the Data Science team on accessing and working with the data
  • Work on applications to answer complex analytical and real-time operational questions
  • Be a key part of the design, architecture and building of our data platform over a variety of Big Data technologies such as Hadoop, HBase, Spark, Kafka, Druid, etc.
  • Research, explore and develop new data tools that can be used by our Data Scientists and other Data Engineers

Ideal Candidate

  • Has a passion for Computer Science and Big Data technologies, and a flexible, creative approach to problem-solving
  • 3+ years of hands-on experience with the Hadoop stack (MapReduce Programming Paradigm, HBase, Hive and Spark)
  • 3-5+ years experience in Java programming
  • Has experience in streaming programming and distributed processing
  • Has a proven track record of building large scale systems utilizing Big Data Technologies
  • Experience building large-scale server-side systems with distributed processing algorithms
  • Supporting Hadoop developers and assisting in troubleshooting and optimization of mapreduce jobs
  • Excellent experience in design and development of large-scale applications
  • Experience with Kafka or NATs or any streaming or messaging system
  • Experience with Druid is desired
  • Excellent problem solving and programming skills; tried technical leadership and interpersonal skills
  • Aptitude and passion to independently learn new technologies
  • Experience working with Big Data technologies in a public cloud infrastructure (GCloud and AWS)

Bonus

  • Contributions to open source projects such as Apache Hadoop, Spark, Kafka, etc.
  • Proficiency with other programming languages
  • Experience with Data Science tools

Apply for this opening at http://totvslabs.recruiterbox.com/jobs/fk01so7?apply=true