A real-time speech recognition system includes distributed processing across a client and server for recognizing a spoken query by a user. Both the client and server can dedicate a variable number of processing resources for performing speech recognition functions. In some implementations the partitioning of responsibility for speech recognition operations can be done on a client by client or query by query basis.