Deployment Architecture
Overview
The deployment architecture of the Intelligent Universal Data Exchange (IUDX-Novo) platform illustrates the flow of data, control mechanisms, and security safeguards across platform components.
The architecture is designed to ensure secure, efficient, and well-governed data exchange operations, while supporting scalability, observability, and operational resilience.
IUDX Cloud
The IUDX Cloud serves as the central hosting environment for all core platform services and data management systems. It is logically divided into two primary network segments.
Private Network
The Private Network hosts internal platform components, including:
Internal services and control-plane components
Data pipelines and processing systems
Storage and persistence layers
Access to this segment is protected through restricted access controls, network isolation, and internal-only routing.
Public Network
The Public Network exposes selected platform services to users through secure gateways.
Key characteristics:
Only explicitly exposed services are accessible
All access is mediated via gateway components
Communication is secured using TLS-based encryption
Both network segments are protected using firewalls, network isolation techniques, and encrypted communication.
Gateways and Servers
Identity Gateway and Server
The Identity Gateway and Server handle platform identity and access management.
Responsibilities include:
User and client authentication
Token-based authorization
Secure identity verification
Enforcement of permission checks prior to resource access
AAA Gateway and Server
The AAA (Authentication, Authorization, and Accounting) Gateway and Server enforce access governance across the platform.
Key functions:
Validation of tokens issued by the Identity Server
Enforcement of authentication and authorization policies
Application of access-control rules
Maintenance of user activity logs for auditing and compliance
Catalogue Gateway and Server
The Catalogue Gateway and Server manage all metadata-related operations.
Responsibilities include:
Handling dataset discovery and metadata queries
Managing metadata for all datasets registered on the platform
The Catalogue Server serves as the metadata registry for the IUDX platform.
Resource Gateway and Server
The Resource Gateway and Server manage data ingestion and access.
Key responsibilities:
Ingestion and processing of data from Data Providers
Validation of access tokens and policies
Secure processing and transfer of data into and through the platform
Data Pipeline Components
Data Broker
The Data Broker facilitates data flow between external sources and internal processing components.
It:
Acts as an intermediary in the ingestion pipeline
Supports decoupled and asynchronous data movement
Enables scalable and reliable ingestion workflows
Credentials and Policy Data Store
This datastore maintains:
Authentication credentials
Access-control policies
Data-sharing rules
It plays a critical role in enforcing authorization decisions throughout the data exchange lifecycle.
Data Stores
Metadata and Data Store
This datastore:
Maintains dataset metadata
Stores data exchanged through the platform
It supports both discovery and access workflows.
Auditing and Metering Data Store
The auditing and metering datastore:
Tracks data access events
Records resource usage metrics
Stores metering information for:
Compliance
Monitoring
Billing and credit management workflows
Metrics, Logs, and Monitoring
The monitoring subsystem provides end-to-end observability across the platform.
Capabilities include:
Continuous monitoring of system health and performance
Collection of operational metrics and logs
Detection of anomalies and critical events
Critical alerts are forwarded to the Alerting System, which notifies administrators for timely intervention.
Backup System
A dedicated backup mechanism ensures:
Data integrity
High availability
Disaster recovery readiness
Regular backups of critical data and configurations support platform resilience and recovery.
Network Security Model
Public Network Access
Users access the platform through secure, token-authenticated endpoints
All incoming requests pass through designated gateways:
Identity
AAA
Catalogue
Resource
These gateways validate requests before forwarding them to backend services.
Private Network Access
Hosts internal data pipelines, storage systems, and monitoring utilities
Access is restricted to:
Internal services
The DX systems and operations team
This ensures controlled operational environments and secure data handling.
Role of Administration
The administrative entity is responsible for:
Platform-wide operations and governance
Policy management and enforcement
System health monitoring
Security oversight of deployed components
Summary
The IUDX-Novo deployment architecture incorporates multiple layers of security, governance, and operational monitoring.
This design ensures that the platform functions as a reliable, secure, and scalable data exchange system, capable of supporting diverse data sharing, analytics, and AI-driven workflows.
Last updated

