Product Best-Practices White Paper
A modern Data Lakehouse solution with Open and Unified data processing platform for Data Lake and Data warehouse.
Nexaris iiDrak Data Platform – Product Best-Practices White Paper
Version: 1.0
Last Updated: June 2025
Audience: Enterprise Architects, Platform Engineers, Data Leaders
1. Executive Summary
This white paper outlines best practices for deploying, securing, and optimizing the Nexaris iiDrak Data Platform. It serves as a reference guide to maximize the platform’s capabilities across modern data, analytics, and AI workloads.
2. Deployment Best Practices
- Use hybrid or multi-cloud deployment to avoid vendor lock-in.
- Leverage BYOC and BYOS to optimize cost and infrastructure reusability.
- Choose executor types based on data size: Spark for large datasets, DuckDB for mid-size, WASM for small data/exploration.
- Ensure data locality by placing compute closer to data storage.
3. Data Governance & Security Best Practices
- Enforce role-based access control (RBAC) using Guardium.
- Implement row-level and column-level masking for PII.
- Enable audit logs and track query-level access.
- Use federated query access to avoid data duplication and movement.
- Establish regular access reviews and security audits.
4. Data Pipeline Development Best Practices
- Use the visual builder for fast prototyping and ETL orchestration.
- Modularize pipelines for reuse and easier debugging.
- Implement retry and alerting mechanisms for critical pipelines.
- Use versioning and maintain dev/test/prod environments.
5. AI & ML Best Practices
- Use Wa-SuL AI Studio for collaborative, low-code ML workflows.
- Maintain feature consistency across training and inference.
- Track experiments and models through built-in versioning.
- Use the OCR and RAG capabilities to enable multimodal ML workflows.
6. Query Optimization Tips
- Leverage materialized views for repeated analytical workloads.
- Apply partitioning and clustering to Iceberg tables for faster access.
- Use federated SQL queries to reduce ETL overhead.
- Enable caching at the query gateway layer.
7. Monitoring and Observability
- Use built-in dashboards to monitor resource usage.
- Enable alerts for executor failures and long-running queries.
- Monitor data pipeline health visually and set thresholds.
8. Compliance and Auditability
- Enable full-stack audit logs via Guardium.
- Use policy enforcement and access certification periodically.
- Retain logs and query histories for regulatory review.
9. Conclusion
The Nexaris iiDrak Data Platform offers unmatched flexibility, security, and AI integration. By adhering to these best practices, organizations can unlock its full potential, accelerate innovation, and ensure enterprise-grade governance.