Event Hubs is a modern big data streaming platform and event ingestion service that can seamlessly integrate with other Azure and Microsoft services, such as Stream Analytics, Power BI, and Event Grid, along with outside services like Apache Spark. The service can process millions of events per second with low latency. The data sent to an event hub (Event Hubs instance) can be transformed and stored by using any real-time analytics providers or batching or storage adapters.
Currently, only measure data can be ingested onto an Event Hub Stream
Configuring a Microsoft Azure Event Hub Consumer
To create a connection using an Azure Event Hub Consumer, right-click on Data Consumers, and select “New", Microsoft”.
This will list the SQL Consumer called “Azure Event Hub”. Select The “Azure Event Hub” consumer to open its editor:
To successfully push data to a Microsoft Azure Event Hub Consumer, the following properties need to be set.
|
Name that descriptively identifies the consumer. |
|
The Name of your Event Hub as defined in the Azure Portal. |
|
Endpoint section of the connection string as copied from your Azure Portal |
|
The Shared Access Key Name as copied from the connection string from your Azure Portal |
|
The Shared Access Key as copied from the connection string from your Azure Portal |
|
The Entity Path as copied from the connection string from your Azure Portal |
|
JSON format of payload to be ingested. |
Configure a Measure to Replicate
From your Flow model, select and open the configuration of a measure that you want to replicate to the configured Event Hub. Dragging the data consumer onto the specific context to be replicated will create four sample queries that need to be modified to reflect the schema of the database that you are pushing data to.
Note: Only Calendar Context can be pushed to an Event Hub.
Depending on the context selected to be pushed for the particular measure, certain placeholders can be utilized in the Payload Format that will be replaced by values received from the Integration Engine.
Examples of the particular queries and placeholders for both Calendar and Event contexts is found in What Placeholders can I use when configuring a database-type Data Consumer?
Example Event Hub Connection String (Get connection String example)
Endpoint=sb://flowsoftware.servicebus.windows.net/;SharedAccessKeyName=FlowSender;SharedAccessKey=R6u78hsfBENotARealKey2QkAwH5+AEhLCIV74=;EntityPath=testhub
The following placeholders will be used as per the consumer settings provided:
"Endpoint={Endpoint};SharedAccessKeyName={SharedAccessKeyName};SharedAccessKey={SharedAccessKey};EntityPath={EntityPath}"