When using a Copy Activity with a REST source in Microsoft Fabric, the current activity input and output only provide minimal metadata about the request and response. This makes troubleshooting difficult, especially when using dynamic URLs, query parameters, pagination, or REST APIs that rely on correlation IDs for traceability. Today, the activity input shows basic request settings such as method, timeout, and configured headers, but it does not show the final resolved request URL or the details of the HTTP response returned by the server. Without this information, diagnosing issues like invalid query parameters, authentication failures, pagination errors, throttling, and server-side errors is significantly harder. Problem / Pain Point: When a REST-based Copy Activity fails or behaves unexpectedly, users cannot see the actual request URL, including the evaluated query string. They cannot trace the request back to server logs because correlation IDs are not surfaced. They cannot inspect the HTTP status line, response headers, or the response body returned during an error. Pagination information such as Link headers is also missing. These fields are standard diagnostics for debugging REST calls, and without them, troubleshooting in Fabric becomes guesswork. Proposed Enhancement: Add the fully resolved request URL to the Activity Input. This should include the full URL with dynamically evaluated parameters and query string so developers can see exactly what Fabric sent to the server. Expand Activity Output to include detailed HTTP response metadata. The requested fields are: HTTP Status Line (for example: HTTP/1.1 404 Not Found) Response Headers, specifically: Correlation ID (such as X-Request-ID or X-Correlation-ID) Timestamp returned by the server Content-Type Content-Length Link header (RFC 5988) for pagination Response body when the server returns an error (HTTP 4xx or 5xx) Impact / Value: Adding this metadata would significantly improve troubleshooting for REST ingestion pipelines, allow correlation with server logs using correlation IDs, reduce debugging time for dynamic URL issues, improve visibility into pagination and throttling scenarios, and bring feature parity with tools like Azure Data Factory. This enhancement would make REST-based data ingestion in Fabric more reliable, debuggable, and aligned with enterprise observability practices.
... View more