So, in my learnings and conversations with people over the past week, I’ve just discovered this concept of Complex Event Processing. It’s a fascinating subject — taking a fast moving data stream and performing analysis of it in real time. I’m looking at a (PowerPoint alert!) presentation that say they achieve a 1msec lag in some cases using an on-the-fly db with SQL-like syntax.
This is truly fascinating business. Anyone out there in blogland into this CEP stuff. Tell me all about it, educate me.
Hi,
I have a message oriented middleware (MOM) that facilitates the gathering of information produced by equipment running in the production lines. Each equipment can produce 6,000 messages in an hour. There can be 20-30 of such kind of equipments in a production line. Not mentioning other type of equipments running at other production lines.
I face difficulty in providing a steady stream of compiled real time information to the viewer. I have downnloaded coral8 (http://www.coral8.com) – which is a system base on CEP and hopefully it can help me solve the problem. I am still evaluating it against my system.
Vendor Alert (my apologies in advance)!
Hi Seemant,
I represent Coral8, the vendor that Joel mentioned in his comment. Our CEP solution is very easy to use and can be downloaded off our web site http://www.coral8.com for evaluation. Please feel free to have a look, or contact me with any questions you might have about CEP in general or Coral8’s technology in particular.
Best Regards,
Jeff Wiederholt
jeffw@coral8.com
Joel, Jeff,
Thanks for visiting and reading my blog entry. Joel, I might suggest you also give the StreamBase solution a try — it’s also available for download. I got a preview copy of the linux application (since I don’t run Windows (TM) anywhere at all), and I must say it’s quite nice.
Jeff, I’ve certainly looked through the Coral8 site in the past few weeks. I see you have x86 rpms for the coral8 client. I will definitely have a look-see.
Joel,
If your goal is to process 6,000 messages in an hour from 30 machines, that sounds like about 50 messages/second. CEP software such as StreamBase can readily do this, and we would be glad to have you evaluate your software (www.streambase.com). If you have additional production lines or locations which increase the data rates, we can also handle this easily. If your maximum data rates are still in the range of several hundred messages/second, depending on the complexity of the processing, you may also want to explore other middleware or system software alternatives.
They’ll never make a movie about it unless you can find a way to represent the data in an iTunes-style colourful visual display, and then have an eccentric young against-the-grain research student stumble upon the ability to detect and describe useful aggregations of complexity in real-time by watching the screen.
Don’t worry, he or she doesn’t have to get laid. They’ll just write that shit in later.
Love,
Cheeseburger Brown
Hi CBB 🙂
Now I have yet to still try Coral8’s client, but StreamBase’s client looks basically like Eclipse — and it lets you drag and drop objects to connect them, etc. In other words, it’s basically sexy 🙂
Though figuring out a plot for it in a movie is a different story… 😛