DISQUS

Chad · 2 years ago

Cool stuff. Haven't had a chance to dive into the code yet but I'd say you are onto something good.

The background you provide about databases, Google's infrastructure, etc., are spot on.

Here is a panel I participated in on this particular topic: http://www.geeksessions.com/2007/10/08/geeksess...

Not sure if you are aware of Hadoop (http://lucene.apache.org/hadoop), which is an open-source implementation of a large-scale distributed file system and map-reduce system. It is led by Doug Cutting, creator of Lucene, and Yahoo! has a pretty large group of people contributing to it. There is a sub-project of Hadoop called Hbase (http://wiki.apache.org/lucene-hadoop/Hbase), which my team is contributing to -- Hbase is a column-oriented DB.

We're also using Thrift quite heavily, including your earlier contribution on the asynch server stuff. I had the same reaction when I heard about Thrift: open-source protocol buffer. Did you implement a Thrift transport based on Spread? That's something we have been mulling over but haven't quite started on yet.

Chad Walters
Powerset

electronic discovery · 8 months ago

Thanks for bringing this up, just exactly what I needed, hope I can give some feedbacks after I checked it out.