In this post we will see the architecture behind queue processor rule and all its configurations and usages. This post is documented using Pega personal edition 8.4 What is a queue processor rule? Used for background processing that makes use of queue management and performs the processing.Queue processor rule uses Kafka message queuing and so …
In this post we will make use of data sets we created in the previous post and we will also verify how data flows can be used in Pega to process source data. This post was implemented using Pega Personal edition 8.4 For a better understanding on data flow tutorial, I recommend you go through …
In this post we will see some basics about data set rule using YouTube as the data source. The tutorial was implemented using Pega personal edition 8.4 What is a data set rule? The name speaks itself. It is a collection or a set of data.The source data can be from different systems and can …
In this post we will see how Pega uses Kafka internally to process streams of data, just an overview on streams service. Tip: If you are into Kafka topic for the first time in my blog, I recommend you go through the Kafka series posts in order. This tutorial is implemented using Pega personal edition …
In this post we will set up Kafka in Windows and start producers and consumers using CLI. We will also see how the messages get consumed. I recommend you to go through my previous post on Kafka fundamentals before proceeding here. Let’s straightaway start downloading the binaries. Step 1: Make sure you have Java JDK …
Welcome to the first post on Kafka series. Here we will talk some theory concepts on Kafka fundamentals. What is Kafka? Kafka is a distributed streaming platform. Stream here refers to stream of data. Imagine an organization has around 3 source systems and 4 target systems. Each system needs to communicate with each other to …
In the last two posts, we saw about system name, clusters and nodes. In this post, we will see how we can classify the nodes. I suggest to you to go through the previous posts on System name and Nodes Introduction posts. – Why to classify nodes? Effective resource allocation Imagine an Insurance organization uses …
In this post we will see some basics about Clusters and Nodes What is a cluster? A cluster is a group of servers and resources that work together.Just for logical reason, you can map a cluster with the system name, we saw in the previous post. Think of the Pega Personal edition. Installing Pega package …
What is a system instance in Pega? System is a data instance that belongs to SysAdmin category.System name uniquely identifies each system and corresponds to Pega Platform system For example In an Organization – mkp_dev, mkp_st, mkp_uat, mkp_prod can uniquely identify the development, test, acceptance and production systems in mkp department – where as ctm_dev, …
In this post, we will see how we can setup dashboards in Kibana using the elastic data. A short introduction about Kibana. Open source visualization tool on elastic dataIt uses the REST API provided by elasticsearch and queries the data.It ships with a nice user interface to create visualization and dashboard on the elasticsearch data. …
Introduction In this post, we will set up a Logstash server in our local machine. We will also configure filebeat to ship the log files to logstash and logstash will stash those log file entries into elasticsearch server. For a better understanding, I would recommend to go through the posts on elk topic in order …
Introduction In this post, we will set up a filebeat server in our localmachine. We will also use filebeat to ship the Pega logs into elastic server. Finally, we will use Kibana tool, to query on the shipped log entries from elastic server. For a better understanding, I would recommend to go through the posts …
ELK 4 – Setup Filebeat and Pega log JSON objects Read More »
Introduction In this post, we will set up and run Kibana in our local machine. We will also use REST APIs from elastic to create indexes and documents manually using DSL query. For a better understanding, I would recommend to go through the posts on elk topic in order from 1-6 http://myknowpega.com/tag/elk/ Open source visualization …
Introduction In this post, we will set up and run an elasticsearch node in our local machine. We will also see some important configurations. For a better understanding, I would recommend to go through the posts on elk topic in order from 1-6 http://myknowpega.com/tag/elk/ What is elasticsearch? Open source search and analytics engineBuild on Apache …
Introduction This is the first post in the series of ELK stack. Here we will see some basic theoretical knowledge about ELK stack. Let’ start hunting the ELK 🙂 Fun fact: ELK is a large species deer! What is ELK? ELK – stands for Elastic, Logstash and Kibana. Elastic – Search or analytics engine that …
