mirror of
https://github.com/github/awesome-copilot.git
synced 2026-02-24 04:15:14 +00:00
Fabric Lakehouse Skill
This is new skill for Copilot agent to work with fabric Lakehouse
This commit is contained in:
36
skills/fabric-lakehouse/references/getdata.md
Normal file
36
skills/fabric-lakehouse/references/getdata.md
Normal file
@@ -0,0 +1,36 @@
|
||||
### Data Factory Integration
|
||||
|
||||
Microsoft Fabric includes Data Factory for ETL/ELT orchestration:
|
||||
|
||||
- **180+ connectors** for data sources
|
||||
- **Copy activity** for data movement
|
||||
- **Dataflow Gen2** for transformations
|
||||
- **Notebook activity** for Spark processing
|
||||
- **Scheduling** and triggers
|
||||
|
||||
### Pipeline Activities
|
||||
|
||||
| Activity | Description |
|
||||
|----------|-------------|
|
||||
| Copy Data | Move data between sources and Lakehouse |
|
||||
| Notebook | Execute Spark notebooks |
|
||||
| Dataflow | Run Dataflow Gen2 transformations |
|
||||
| Stored Procedure | Execute SQL procedures |
|
||||
| ForEach | Loop over items |
|
||||
| If Condition | Conditional branching |
|
||||
| Get Metadata | Retrieve file/folder metadata |
|
||||
| Lakehouse Maintenance | Optimize and vacuum Delta tables |
|
||||
|
||||
### Orchestration Patterns
|
||||
|
||||
```
|
||||
Pipeline: Daily_ETL_Pipeline
|
||||
├── Get Metadata (check for new files)
|
||||
├── ForEach (process each file)
|
||||
│ ├── Copy Data (bronze layer)
|
||||
│ └── Notebook (silver transformation)
|
||||
├── Notebook (gold aggregation)
|
||||
└── Lakehouse Maintenance (optimize tables)
|
||||
```
|
||||
|
||||
---
|
||||
Reference in New Issue
Block a user