Senior Cloud/Data Engineer: Big Data Indexing & Cryptography Architecture on Google Cloud (GCP)

Project Description

We are currently seeking a visionary Cloud Architect for a highly sensitive, data-intensive project.

###IMPORTANT PRELIMINARY NOTE (Mandatory NDA):
Due to the highly sensitive nature of the datasets to be processed and the specific analytical objectives of this project, the final awarding of the contract strictly requires the signing of a comprehensive NDA (Non-Disclosure Agreement). Therefore, the project objectives are described here in abstract terms only.

###Project Overview:
We need a powerful, data-driven architecture on the Google Cloud Platform (GCP). The system must be designed to collect, index, and structure massive datasets within the field of cryptography. It must be capable of cross-referencing enormous volumes of data from various databases and sources with high performance, processing search queries in milliseconds. The system must be accessible via a secure API and continuously fed with new data sources and database dumps (exports) via a CMS (Content Management System).

###Core Requirements:
-Google Cloud Architecture: Scalable setup for massive datasets and rapid querying on GCP (e.g., BigQuery, Cloud SQL, or high-performance NoSQL solutions).
-High-Performance Data Ingestion (Data Pipelines): Development of efficient pipelines to continuously import, clean, and link large volumes of cryptographic values (hash values and corresponding strings).
-Secure API Architecture: Creation of a robust RESTful or GraphQL API with strict API key management for our internal interfaces.
-CMS Integration: Setup of a lightweight admin dashboard. Our team must be able to seamlessly add new data sources (APIs, database files, websites), which the system will automatically process and integrate into the index.

###Advanced Features & Architecture Vision:
-Intelligent Indexing & AI Support: Utilization of models to optimize the database architecture and accelerate search and matching processes (high-speed lookups) within massive datasets.
-Elastic Scalability (Dynamic Scaling): The system must dynamically ramp up resources during heavy computational operations and minimize them during idle times.
-Highest Security Standards: Implementation of a Zero-Trust Architecture (a security framework requiring strict identity verification for every person and device trying to access resources, regardless of whether they are inside or outside the network perimeter) to protect the aggregated and indexed data.

###Your Profile:
-Absolute reliability and unconditional readiness to sign an NDA.
-Proven experience with GCP, focusing on Big Data, databases, and High-Performance Computing.
-Expertise in the rapid processing and searching of massive datasets.
-Understanding of cryptographic fundamentals (specifically hash functions).

###Application:
Please begin your application with the word "Xantium_333" so we know you have read this posting thoroughly. Please confirm your readiness to sign an NDA directly in your cover letter to learn the full technical specifications in the next phase. Show More

Attachments

Freelancers Bidding (0)

  • This project has no proposals yet.
    Be the first to place a bid on this project!