USA Remote Databricks Engineer specializing in PII data anonymization, data scrubbing, and building secure synthetic test environments using Databricks on Azure with cloud migration experience.
Opportunity Overview
- Focus on data scrubbing / anonymization within Databricks
Key Objectives
- Remove all PII from test bank data
- Create a separate test environment with fully scribed/synthetic data
- Leverage Databricks AI to scrub and sanitize data
- Identify a key/identifier framework to maintain data traceability post-scrub
Technical Environment
- Current: Databricks in Azure
- Future state: Migration to AWS
- Must have experience with:
- Databricks
- Databricks AI / data processing
- Cloud (Azure → AWS transition awareness preferred)
Timeline
- Target start: ASAP
- Deadline: TBD (not yet defined)
Client Expectations
- Looking for a partner that can:
- Demonstrate prior experience with similar data anonymization / Databricks projects
Suggested Positioning
- Emphasize:
- Prior Databricks + data privacy / anonymization use cases
- Ability to structure hybrid delivery (onshore + offshore support)
- Experience handling secure environments with access restrictions