19-08-2020
Software Engineer
* Please note that most of the time you’ll work fully remote, except in occasional circumstances.
Complex problems require the right expertise! Today, one of the biggest challenges lies in data storage and processing, across these three main domains (3Vs): Volume, Velocity and Variety.
At Xpand IT, the Big Data technological area develops and implements architectures and software solutions that represent the state of the art on capturing, ingesting, storing and managing critical data from huge clusters where the 3Vs are always present. As concerns technology stack, we take advantage of almost every state-of-the-art framework in Big Data ecosystem such as Spark, Kafka, Hive/Impala, Azure Data Services or MongoDB using Java and Scala as programming languages to interact with them.
YOUR ROLE
As a Software Engineer, you’ll play a key role in the team along with Big Data Platform Engineers to create the best software solutions, applying big data best practices in terms of architecture and systems design. You’ll ensure that backend software performance, reliability and scalability are achieved regardless of how fast data clusters grow or the throughput of information increases.
Your daily activities will include:
- Implementing solutions in distributed architectures in which the performance of processing large data volumes is essential
- Designing robust and reliable software solutions regardless of the amount of input data
- Implementing big data industry standards into the end software solution
- Analysing complex problems that need solutions for efficiently manipulating huge amounts of information
- Developing data models and data organisations that optimise “search” and “store” operations in large-scale distributed systems
- Designing APIs for swift data tracking and query data at high speeds
// Stacks: Java/Scala; Spark; Kafka/Confluent; MongoDB; Databricks
SKILLS YOU NEED TO HAVE
- MSc / BSc in Information Systems and Computer Engineering and/or Computer Science
- Experience with Java-oriented technologies (JBoss, Spring, Spring MVC, Hibernate, REST/SOAP)
- Experience with design patterns to implement advanced software solutions.
- Experience with non-relational & relational databases (SQL, MySQL, NoSQL, Hadoop, MongoDB, etc.)
- Sound experience in using Eclipse, Maven, Jenkins, GIT, JIRA or equivalent tools
- Sound communication skills (written and spoken)
// Will be a nice plus if you have:
- Knowledge or experience with distributed computing/storage frameworks such as Apache Spark, Kafka or cloud-native solutions like Databricks, EMR or DataProc
- Team player and problem-solving skills
// Learn more about Big Data area:
André Pires, Big Data Software Engineer
@Xpand IT
A Big Data Software Engineer is challenged every day to build scalable and resilient data processing systems that are the groundwork for data-driven decisions.
