Implementing Event Streaming
Use these steps as a summary of tasks required for event streaming in a MATRIXX environment.
- Determine the hardware and software that event streaming requires:
- No extra hardware is required to run the Event Streaming Framework. Dedicate systems to primarily run the Event Streaming Framework if your MATRIXX environment has a heavy event streaming load.
- No extra hardware is required to run the Event Stream Server on publishing pods.
For more information about infrastructure requirements and third-party software requirements, see MATRIXX Installation and Upgrade.
- Install MATRIXX Engine pods.
- Install the event streaming pod.
- (Optional). If your MATRIXX environment requires the Event Streaming Framework HA features, specify a replica set to ensure that a specified number of pods are running at any given time.
- Configure the Traffic Routing Agent (TRA) for publishing pods (TRA-PUB).
For more information, see the discussion about configuring the engine-level TRA pods (TRA-PROC and TRA-PUB) in MATRIXX Installation and Upgrade.
- (Optional) If your MATRIXX environment uses sub-domain routing, configure an Event Streaming Framework virtual server (VS) for the TRA-RT-(SI/DR) for each sub-domain while configuring
the TRA DR-(SI/DR). The TRA configuration requires that:
- The VS points to the external-facing VIP.
- The VS protocol is set to evs.
- The VS pool balance method is domain_id_protocol.
For example:<vip name="vip-int-1" ifName="lo" address="127.0.0.101" netmask="32"/> <vs name="intStreamSD1" vip="vip-int-1" port=[port] protocol="evs" pool="streamSD1Pool"/> <pool name=""streamSD1Pool"" balance-method="domain_id_protocol"> <node name="sd1e1pub" id="1" address=[engine 1 publisher TRA-LB VIP]/> <node name="sd1e2pub" id="1" address=[engine 2 publisher TRA-LB VIP]/> </pool>
For more information about TRA configuration, see the discussion about configuring a Traffic Routing Agent in MATRIXX Installation and Upgrade.
- In MATRIXX Engine, configure the create_config.info
parameters and the publishing pod NFS export table.
For more information, see the discussion about configuring event streaming.
- On the Event Streaming Framework pod, create the event stream definitions for
the event streams you want MATRIXX Engine to generate.
Include your event stream definitions in the Event Streaming Framework configuration. The Event Streaming Framework sends your definitions to MATRIXX Engine cluster upon start-up. Define different event streams for each sub-domain in your environment. The Event Streaming Framework includes an out-of-the-box configuration file that serves as a template for defining custom event streams.
To configure the Event Streaming Framework:- Edit the Event Streaming Framework properties file.
For more information, see the discussion about configuring Event Streaming Framework properties and examples.
- Configure the Event Streaming Framework connectors.
Configure one of the default connectors.
For more information, see the discussion about the Event Streaming Framework connectors.
- Edit the Event Streaming Framework properties file.
- Start a MATRIXX Engine.
- Start the Event Streaming Framework.
- Verify that event streaming is occurring in your MATRIXX environment by checking logs.
For more information about reconfiguring an existing event stream, see the discussion about reconfiguring event streaming during runtime.