A data product is a curated, ready-to-use collection of data designed for specific business needs. In our self-service environment, authorized users can create and share data products based on our gold layer data—prevalidated, integrated datasets that meet institutional standards. Data products can include dashboards, reports, datasets, analytical models, or data feeds.
Types of Data Source Integration Requests
New Source Integration: This involves a complete process including onboarding the source system, developing data pipelines, and creating the product.
Existing Source Enhancement: This uses already integrated data sources and focuses mainly on product development.
Integrations require access to the data source - we cannot begin integration work until appropriate connections and permissions are established.
Data Product Delivery Process
- Intake & Validation
- Document the request and business needs
- Verify approvals from stakeholders and data ownership
- Classify data sensitivity and establish security requirements
- Design & Planning
- Map necessary data elements to available sources
- Define transformation logic and data model
- Document technical specifications and dependencies
- Estimate resource needs and timeline
- Development & Testing
- Build data pipelines
- Implement data quality checks and validation rules
- Apply role-based access controls according to the security framework
- Set up row/column level security if needed
- Document security implementation for compliance
- Execute test plans against defined acceptance criteria
- Validate data accuracy against source systems
- Ensure performance meets expectations
- Deployment & Documentation
- Migrate to the production environment
- Register metadata in Purview
- Update the data dictionary and lineage documentation
- Prepare user documentation and training materials if necessary
- Provide access to authorized users
- Inform stakeholders about availability
Service Level Targets by Request Type
| Request Type |
Initial Response |
Estimated Timeline Range |
Factors Affecting Timeline |
| New Source Integration |
5 business days |
4-12 weeks |
- Complexity of the source system
- Data volume
- Transformation needs
- Security considerations
|
New Data Product
(Existing Source) |
3 business days |
2-6 weeks |
- Complexity of business logic
- Number of data sources
- Visualization needs
- Testing complexity
|
| Self-Service Assistance |
2 business days |
1-2 weeks |
- Type of assistance needed
- Current user capability
- Availability for training
|
| Access Request |
1 business day |
1-3 business days |
- Requested security level
- Approval requirements
- Identity verification needs
|
| Critical Fix/Issue |
4 hours |
1-3 business days |
- Complexity of the issue
- System dependencies
- Testing requirements
|
Timeline estimates reflect typical projects but may vary based on:
- Complexity and completeness of the request
- Current team workload and capacity
- Alignment with institutional priorities
- Resource availability and dependencies
- Responsiveness of stakeholders
Critical institutional initiatives receive priority. We will provide clear updates throughout the process and collaborate with you to address any timeline adjustments.