Hadoop Developer Job Description Template
Company Briefing
Start your Hadoop Developer job posting with a short introductory paragraph presenting your company to the candidate. Be sure to provide as much meaningful and relevant background information about your company as possible, namely the niche in which you operate, your target audience, as well as any significant milestones that your company is proud to have achieved. Position your company as an attractive place for your candidates to work. Speak positively about the work environment that your company promotes as well as the general working conditions that a candidate can expect. Don’t forget to make mention of any perks that your company offers, including any possible healthcare plan or compensation package that you may offer. Wrap up this section with a short sentence encouraging candidates to apply for the job as, if they don’t, they’ll be missing out on an opportunity to work with a company that’s as awesome as yours.
Job Description
Our SaaS company is searching for an epic Senior Hadoop developer with the expertise, commitment, passion, drive, energy, and spirit to spearhead a series of software projects that we are working on. To be more specific, in your capacity as our in-house big data developer, you will act as our main Hadoop administrator who will be responsible for overseeing all software development related to Hadoop applications. Your job responsibilities imply that you will form the cornerstone of our data warehouse unit as your insight and applied expertise will be crucial to our business’ ability to succeed. Since your job role is integral to our success, we have ensured that you have the support needed to accomplish your tasks. Your job title mandates that you form part of a three member team including one (1) Junior Hadoop developer, one (1) Chief Technology Programmer, and yourself. The Junior Hadoop developer will report to you and you, in turn, will report directly to the Chief Technology Officer.
Responsibilities
- Attend periodic meetings with project managers, stakeholders, and the Board of Directors to plan the way forward regarding product creation and management
- Meet with development team and plan a logical and feasible schedule regarding completion of project tasks
- Access the company’s Big Data infrastructure along with other members of the software development team
- Craft frameworks dedicated to data processing
- Find, extract, and isolate data clusters
- Test scripts and participate in results analysis
- Troubleshoot and fix application bugs
- Ensure the protection of company data
- Generate and monitor programs designed for data tracking
- Guarantee seamless interaction between MapReduce and HDFS
- Approve ETLs ensuring that they are scalable and can be maintained (if you need ETLs)
Skills Required
- At least six (6) years of experience working as a full-time Hadoop Developer, Big Data Engineer, or a similar career path
- Ample experience operating with SQL, Hive, Pig, HBase, and Apache Flume
- Has worked with Oracle, Linux, Unix, Kafka, and YARN
- Familiar with Oozie, Sqoop and Spark
- Has done back-end development
- In-depth knowledge of Java and Python (or other top programming languages)
- Has written Pig Latin Scripts
- Accomplished scheduler
- Scripting and querying wizard
- Good knowledge of high-performance machine learning software and big data applications
- Experience in data science
- At least a Bachelor’s degree in Information Technology, Computer Science, Data Analytics, or a relevant field
- Excellent communication skills
- Superb problem solving skills