Gearman & TheSchwartz (was: Cache miss stampedes)

Ask Bjørn Hansen ask at develooper.com
Mon Jul 30 07:47:52 UTC 2007


On Jul 27, 2007, at 16:41, Brad Fitzpatrick wrote:

> This is totally the wrong list, but...

Moving it to the right list.  :-)

> Gearman:  low latency, failures/retries done by client (who's waiting,
> perhaps on dozens of things in parallel).  No disks involved.  Just  
> load
> balancing function calls inside your network.
>
> TheSchwartz:  high latency.  retries done by system.  database(s)
> involved, thus disks.  use for long/slow tasks like sending email  
> or SMS
> or video transcoding, etc... gearman is for calling functions  
> elsewhere on
> your network while you wait.
>
> Both complement each other wonderfully.  Neither is going away nor  
> being
> folded into the other.

Why can't TheSchwartz just be a kind of backend to gearman / use the  
gearman protocol and services?

Something like:

Queue A Job:
    Client -> gearmand -> TheSchwartzWorker (as a sub-process or 3  
off the gearmand)

Get A Job Done:
    TheSchwartzScheduler (again process from gearmand) -> gearmand ->  
JobWorker -> ...



    - ask

-- 
http://develooper.com/ - http://askask.com/




More information about the Gearman mailing list