A serious problem I see with really small batches is that the need for precision in measuring grain, hops, and yeast increases. You can probably get by with a measurement precision of a gram or so with a 5 gal or larger batch, but that needs to be finer when you're only dealing with a few pounds of grain or grams of hops.