Spark, Scala Developer
FULL TIME
Brooklyn, OH - Onsite
only USC/GC / C 09 GC EAD / OPT
Proven big data experience, either from an implementation or a data science prospective.
Knowledge of Scala and Hive which requires coding experience using parquet 4.
Advanced SQL knowledge requiring writing SQL queries.
Experience having worked with GCP data lake.
Experience in working in an Agile environment.
Expert knowledge of at least one big data technology such as Spark, Hadoop, or Elasticsearch.
A strong coding background in either Java, Python or Scala.
Experience with testing libraries of common programming - for example scalatest (or equivalent packages for other languages).
Knows the difference between different test types (unit test vs integration test for example).
Can explain unit testing and how they have been automated.
Experience of building data processing pipelines for use in production "hands off" batch systems, including either traditional ETL pipelines and/or analytics pipelines.
Job Type: Full-time
Pay: $94,923.00 - $120,444.00 per year
Benefits:
Dental insurance
Health insurance
Paid time off
Schedule:
8 hour shift
Monday to Friday
Application Question(s):
Please Mention your Work Authorization (USC OR GC OR OPT OR GC EAD)?
Are you open to relocate?
Experience:
Spark/Scala: 6 years (Preferred)
parquet 4: 4 years (Preferred)
Angular: 1 year (Preferred)
SQL queries: 5 years (Preferred)
Hadoop, or Elasticsearch: 3 years (Preferred)
GCP data lake: 3 years (Preferred)
Ability to Commute:
Brooklyn, OH (Preferred)
Ability to Relocate:
Brooklyn, OH: Relocate before starting work (Preferred)
Work Location: On the road
Location: United States
Posted: Sept. 2, 2024, 8:14 a.m.
Apply Now Company Website