You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: data-explorer/data-factory-command-activity.md
+28-28Lines changed: 28 additions & 28 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,17 +1,17 @@
1
1
---
2
-
title: 'Use Azure Data Explorer management commands in Azure Data Factory'
3
-
description: 'In this topic, use Azure Data Explorer management commands in Azure Data Factory'
2
+
title: Use Azure Data Explorer Management Commands in Azure Data Factory
3
+
description: In this topic, use Azure Data Explorer management commands in Azure Data Factory
4
4
ms.reviewer: tzgitlin
5
5
ms.topic: how-to
6
-
ms.date: 09/13/2023
6
+
ms.date: 02/23/2026
7
7
ms.custom: sfi-image-nochange
8
8
9
9
#Customer intent: I want to use Azure Data Explorer management commands in Azure Data Factory.
10
10
---
11
11
12
12
# Use Azure Data Factory command activity to run Azure Data Explorer management commands
13
13
14
-
[Azure Data Factory](/azure/data-factory/) (ADF) is a cloud-based data integration service that allows you to perform a combination of activities on the data. Use ADF to create data-driven workflows for orchestrating and automating data movement and data transformation. The **Azure Data Explorer Command** activity in Azure Data Factory enables you to run [Azure Data Explorer management commands](/kusto/query/index?view=azure-data-explorer&preserve-view=true#management-commands) within an ADF workflow. This article teaches you how to create a pipeline with a lookup activity and ForEach activity containing an Azure Data Explorer command activity.
14
+
[Azure Data Factory](/azure/data-factory/) (ADF) is a cloud-based data integration service that you can use to perform a combination of activities on the data. Use ADF to create data-driven workflows for orchestrating and automating data movement and data transformation. The **Azure Data Explorer Command** activity in Azure Data Factory enables you to run [Azure Data Explorer management commands](/kusto/query/index?view=azure-data-explorer&preserve-view=true#management-commands) within an ADF workflow. This article shows you how to create a pipeline with a lookup activity and ForEach activity containing an Azure Data Explorer command activity.
15
15
16
16
## Prerequisites
17
17
@@ -29,18 +29,18 @@ ms.custom: sfi-image-nochange
29
29
30
30
## Create a Lookup activity
31
31
32
-
A [lookup activity](/azure/data-factory/control-flow-lookup-activity) can retrieve a dataset from any Azure Data Factory-supported data sources. The output from Lookup activity can be used in a ForEach or other activity.
32
+
A [lookup activity](/azure/data-factory/control-flow-lookup-activity) can retrieve a dataset from any Azure Data Factory-supported data source. You can use the output from the Lookup activity in a ForEach or other activity.
33
33
34
34
1. In the **Activities** pane, under **General**, select the **Lookup** activity. Drag and drop it into the main canvas on the right.
1. The canvas now contains the Lookup activity you created. Use the tabs below the canvas to change any relevant parameters. In **General**, rename the activity.
38
+
1. The canvas now contains the Lookup activity you created. Use the tabs under the canvas to change any relevant parameters. In **General**, rename the activity.
> Click on the empty canvas area to view the pipeline properties. Use the **General** tab to rename the pipeline. Our pipeline is named *pipeline-4-docs*.
43
+
> Select the empty canvas area to view the pipeline properties. Use the **General** tab to rename the pipeline. The pipeline is named *pipeline-4-docs*.
44
44
45
45
### Create an Azure Data Explorer dataset in lookup activity
46
46
@@ -70,44 +70,44 @@ A [lookup activity](/azure/data-factory/control-flow-lookup-activity) can retrie
70
70
* Select **Name** for Azure Data Explorer linked service. Add **Description** if needed.
71
71
* In **Connect via integration runtime**, change current settings, if needed.
72
72
* In **Account selection method** select your cluster using one of two methods:
73
-
* Select the **From Azure subscription** radio button and select your **Azure subscription** account. Then, select your **Cluster**. Note the dropdown will only list clusters that belong to the user.
73
+
* Select the **From Azure subscription** radio button and select your **Azure subscription** account. Then, select your **Cluster**. The dropdown only lists clusters that belong to you.
74
74
* Instead, select **Enter manually** radio button and enter your **Endpoint** (cluster URL).
75
75
* Specify the **Tenant**.
76
-
* Enter **Service principal ID**. This value can be found in the [Azure portal](https://ms.portal.azure.com/) under **App Registrations** > **Overview** > **Application (client) ID**. The principal must have the adequate permissions, according to the permission level required by the command being used.
76
+
* Enter **Service principal ID**. Find this value in the [Azure portal](https://ms.portal.azure.com/) under **App Registrations** > **Overview** > **Application (client) ID**. The principal must have the adequate permissions, according to the permission level required by the command being used.
77
77
* Select **Service principal key** button and enter **Service Principal Key**.
78
78
* Select your **Database** from the dropdown menu. Alternatively, select **Edit** checkbox and enter your database name.
79
-
* Select **Test Connection** to test the linked service connection you created. If you can connect to your setup, a green checkmark **Connection successful**will appear.
79
+
* Select **Test Connection** to test the linked service connection you created. If you can connect to your setup, a green checkmark **Connection successful**appears.
80
80
* Select **Finish** to complete linked service creation.
81
81
82
-
1.Once you've set up a linked service, In **AzureDataExplorerTable** > **Connection**, add **Table** name. Select **Preview data**, to make sure that the data is presented properly.
82
+
1.After you set up a linked service, In **AzureDataExplorerTable** > **Connection**, add **Table** name. Select **Preview data**, to make sure that the data is presented properly.
83
83
84
-
Your dataset is now ready, and you can continue editing your pipeline.
84
+
Your dataset is ready, and you can continue editing your pipeline.
85
85
86
86
### Add a query to your lookup activity
87
87
88
-
1. In **pipeline-4-docs** > **Settings** add a query in **Query** text box, for example:
88
+
1. In **pipeline-4-docs** > **Settings**, add a query in the**Query** text box, for example:
89
89
90
90
```kusto
91
91
ClusterQueries
92
92
| where Database !in ("KustoMonitoringPersistentDatabase", "$systemdb")
93
93
| summarize count() by Database
94
94
```
95
95
96
-
1. Change the **Query timeout** or **No truncation** and **First row only** properties, as needed. In this flow, we keep the default **Query timeout** and uncheck the checkboxes.
96
+
1. Change the **Query timeout** or **No truncation** and **First row only** properties, as needed. In this flow, keep the default **Query timeout** and uncheck the checkboxes.
97
97
98
98

99
99
100
100
## Create a For-Each activity
101
101
102
-
The [For-Each](/azure/data-factory/control-flow-for-each-activity) activity is used to iterate over a collection and execute specified activities in a loop.
102
+
Use the [For-Each](/azure/data-factory/control-flow-for-each-activity) activity to iterate over a collection and execute specified activities in a loop.
103
103
104
-
1. Now you add a For-Each activity to the pipeline. This activity will process the data returned from the Lookup activity.
105
-
* In the **Activities** pane, under **Iteration & Conditionals**, select the **ForEach** activity and drag and drop it into the canvas.
104
+
1. Add a For-Each activity to the pipeline. This activity processes the data returned from the Lookup activity.
105
+
* In the **Activities** pane, under **Iteration & Conditionals**, select the **ForEach** activity. Drag and drop it into the canvas.
106
106
* Draw a line between the output of the Lookup activity and the input of the ForEach activity in the canvas to connect them.
1. Select the ForEach activity in the canvas. In the **Settings** tab below:
110
+
1. Select the ForEach activity in the canvas. In the **Settings** tab:
111
111
* Check the **Sequential** checkbox for a sequential processing of the Lookup results, or leave it unchecked to create parallel processing.
112
112
* Set **Batch count**.
113
113
* In **Items**, provide the following reference to the output value:
@@ -117,12 +117,12 @@ The [For-Each](/azure/data-factory/control-flow-for-each-activity) activity is u
117
117
118
118
## Create an Azure Data Explorer Command activity within the ForEach activity
119
119
120
-
1. Double-click the ForEach activity in the canvas to open it in a new canvas to specify the activities within ForEach.
120
+
1. Double-click the ForEach activity in the canvas to open it in a new canvas. Specify the activities within ForEach.
121
121
1. In the **Activities** pane, under **Azure Data Explorer**, select the **Azure Data Explorer Command** activity and drag and drop it into the canvas.
122
122
123
123

124
124
125
-
1. In the **Connection** tab, select the same Linked Service previously created.
125
+
1. In the **Connection** tab, select the same Linked Service you previously created.
126
126
127
127

128
128
@@ -139,33 +139,33 @@ The [For-Each](/azure/data-factory/control-flow-for-each-activity) activity is u
139
139
```
140
140
141
141
The **Command** instructs Azure Data Explorer to export the results of a given query into a blob storage, in a compressed format. It runs asynchronously (using the async modifier).
142
-
The query addresses the database column of each row in the Lookup activity result. The **Command timeout** can be left unchanged.
142
+
The query addresses the database column of each row in the Lookup activity result. You can leave the **Command timeout** unchanged.
> * Time limit: 20 minutes (default), 1 hour (maximum).
150
-
> * If needed, you can append a query to the result using [AdminThenQuery](/kusto/management/index?view=azure-data-explorer&preserve-view=true#combining-queries-and-management-commands), to reduce resulting size/time.
150
+
> * If needed, you can append a query to the result using [AdminThenQuery](/kusto/management/index?view=azure-data-explorer&preserve-view=true#combining-queries-and-management-commands), to reduce resulting size or time.
151
151
152
-
1. Now the pipeline is ready. You can go back to the main pipeline view by clicking the pipeline name.
152
+
1. Now the pipeline is ready. You can go back to the main pipeline view by selecting the pipeline name.
153
153
154
154

155
155
156
-
1. Select **Debug** before publishing the pipeline. The pipeline progress can be monitored in the **Output** tab.
156
+
1. Select **Debug** before publishing the pipeline. You can monitor the pipeline progress in the **Output** tab.
157
157
158
158

159
159
160
-
1. You can **Publish All** and then **Add trigger** to run the pipeline.
160
+
1. Select **Publish All** and then **Add trigger** to run the pipeline.
161
161
162
162
## Management command outputs
163
163
164
-
The structure of the command activity output is detailed below. This output can be used by the next activity in the pipeline.
164
+
The following section describes the structure of the command activity output. The next activity in the pipeline can use this output.
165
165
166
166
### Returned value of a non-async management command
167
167
168
-
In a non-async management command, the structure of the returned value is similar to the structure of the Lookup activity result. The `count` field indicates the number of returned records. A fixed array field `value` contains a list of records.
168
+
In a non-async management command, the structure of the returned value is similar to the structure of the Lookup activity result. The `count` field shows the number of returned records. A fixed array field `value` contains a list of records.
169
169
170
170
```json
171
171
{
@@ -187,7 +187,7 @@ In a non-async management command, the structure of the returned value is simila
187
187
188
188
### Returned value of an async management command
189
189
190
-
In an async management command, the activity polls the operations table behind the scenes, until the async operation is completed or times-out. Therefore, the returned value will contain the result of `.show operations OperationId` for that given **OperationId** property. Check the values of **State** and **Status** properties, to verify successful completion of the operation.
190
+
In an async management command, the activity polls the operations table behind the scenes, until the async operation is completed or timesout. Therefore, the returned value contains the result of `.show operations OperationId` for that given **OperationId** property. Check the values of **State** and **Status** properties, to verify successful completion of the operation.
Copy file name to clipboardExpand all lines: data-explorer/excel.md
+5-5Lines changed: 5 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,9 +1,9 @@
1
1
---
2
-
title: 'Visualize a Query in Excel'
3
-
description: 'In this article, you learn how to use a query from the web UI into Excel, by exporting it directly or by using the native connector in Excel.'
2
+
title: Visualize a Query in Excel
3
+
description: In this article, you learn how to use a query from the web UI into Excel, by exporting it directly or by using the native connector in Excel.
4
4
ms.reviewer: orspodek
5
5
ms.topic: how-to
6
-
ms.date: 02/08/2026
6
+
ms.date: 02/23/2026
7
7
8
8
# Customer intent: As a data analyst, I want to understand how to visualize my Azure Data Explorer data in Excel.
9
9
---
@@ -30,7 +30,7 @@ Export the query directly from the web UI.
30
30
31
31
:::image type="content" source="media/excel/web-ui-query-to-excel.png" alt-text="Screenshot that shows Azure Data Explorer web UI query to Open in Excel." lightbox="media/excel/web-ui-query-to-excel.png":::
32
32
33
-
The query is saved as an Excel workbook in the Downloads folder.
33
+
The query is saved as an Excel workbook in the **Downloads** folder.
34
34
35
35
1. Open the downloaded workbook to view your data. Select **Enable editing** and **Enable content** if requested in the top ribbon.
36
36
@@ -69,7 +69,7 @@ Get data from Azure Data Explorer datasource into Excel.
69
69
70
70
:::image type="content" source="media/excel/complete-sign-in.png" alt-text="Screenshot that shows that show the sign-in pop-up window.":::
71
71
72
-
1. In the **Navigator** pane, navigate to the correct table. In the table preview pane, select **Transform Data** to open the **Power Query Editor** and make changes to your data, or select **Load** to load it straight to Excel.
72
+
1. In the **Navigator** pane, go to the correct table. In the table preview pane, select **Transform Data** to open the **Power Query Editor** and make changes to your data, or select **Load** to load it straight to Excel.
73
73
74
74
:::image type="content" source="media/excel/navigate-table-preview-window.png" alt-text="Screenshot of the Table preview window.":::
Copy file name to clipboardExpand all lines: data-explorer/flow-usage.md
+7-7Lines changed: 7 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -3,7 +3,7 @@ title: Usage examples for Azure Data Explorer connector to Power Automate
3
3
description: Learn some common usage examples for Azure Data Explorer connector to Power Automate.
4
4
ms.reviewer: miwalia
5
5
ms.topic: how-to
6
-
ms.date: 05/04/2022
6
+
ms.date: 02/23/2026
7
7
no-loc: [Power Automate]
8
8
ms.custom: sfi-image-nochange
9
9
---
@@ -18,14 +18,14 @@ For more information, see [Azure Data Explorer Power Automate connector](flow.md
18
18
19
19
Use the Power Automate connector to query your data and aggregate it in an SQL database.
20
20
21
-
> [!Note]
21
+
> [!NOTE]
22
22
> Only use the Power Automate connector for small amounts of output data. The SQL insert operation is done separately for each row.
23
23
24
24
:::image type="content" source="media/flow-usage/flow-sql-example.png" alt-text="Screenshot of SQL connector, showing querying data by using the Power Automate connector.":::
25
25
26
26
## Push data to a Microsoft Power BI dataset
27
27
28
-
You can use the Power Automate connector with the Power BI connector to push data from Kusto queries to Power BI streaming datasets.
28
+
Use the Power Automate connector with the Power BI connector to push data from Kusto queries to Power BI streaming datasets.
29
29
30
30
1. Create a new **Run query and list results** action.
31
31
1. Select **New step**.
@@ -34,7 +34,7 @@ You can use the Power Automate connector with the Power BI connector to push dat
34
34
35
35
:::image type="content" source="media/flow-usage/flow-power-bi-connector.png" alt-text="Screenshot of Power BI connector, showing add row to a dataset action.":::
36
36
37
-
1. Enter the **Workspace**, **Dataset**, and **Table** to which data will be pushed.
37
+
1. Enter the **Workspace**, **Dataset**, and **Table** to which you want to push data.
38
38
1. From the dynamic content dialog box, add a **Payload** that contains your dataset schema and the relevant Kusto query results.
39
39
40
40
:::image type="content" source="media/flow-usage/flow-power-bi-fields.png" alt-text="Screenshot of Power BI action, showing action fields.":::
@@ -47,8 +47,8 @@ The flow automatically applies the Power BI action for each row of the Kusto que
47
47
48
48
You can use the results of Kusto queries as input or conditions for the next Power Automate actions.
49
49
50
-
In the following example, we query Kusto for incidents that occurred during the last day. For each resolved incident, a Slack message is posted and a push notification is created.
51
-
For each incident that is still active, we query Kusto for more information about similar incidents. It sends that information as an email, and opens a related task in Azure DevOps Server.
50
+
In the following example, you query Kusto for incidents that occurred during the last day. For each resolved incident, the flow posts a Slack message and creates a push notification.
51
+
For each incident that is still active, the flow queries Kusto for more information about similar incidents. It sends that information as an email, and opens a related task in Azure DevOps Server.
52
52
53
53
Follow these instructions to create a similar flow:
54
54
@@ -65,7 +65,7 @@ Follow these instructions to create a similar flow:
65
65
:::image type="content" source="media/flow-usage/flow-condition-actions-inline.png" alt-text="Screenshot showing adding actions for when a condition is true or false, flow conditions based on Kusto query results." lightbox="media/flow-usage/flow-condition-actions.png":::
66
66
67
67
You can use the result values from the Kusto query as input for the next actions. Select the result values from the dynamic content window.
68
-
In the following example, we add a **Slack - Post Message** action and a **Visual Studio - Create a new work item** action, containing data from the Kusto query.
68
+
In the following example, you add a **Slack - Post Message** action and a **Visual Studio - Create a new work item** action, containing data from the Kusto query.
69
69
70
70
:::image type="content" source="media/flow-usage/flow-slack.png" alt-text="Screenshot of Slack - Post Message action.":::
0 commit comments