Carbon filters will remove odor and chlorine form the water supply. If you llok at an RO system there are typically 2 canisters. One can be used a as pre-filter to remove sediment and the other is for a carbon filter. The GE RO system at Home Depot both canisters are for carbon filters.
Carbon filters are relatively inexpensive.
http://www.homedepot.com/p/HDX-Carbon-Household-Filter-2-Pack-HDX2CF4/205373472They fit in a canister like this
http://www.homedepot.com/p/Glacier-Bay-Basic-Household-Water-Filtration-System-HDG2BS4/205459550?MERCH=REC-_-categorylevel2horizontal1_rr-_-NA-_-205459550-_-N If you run an RO then it will strip most of the minerals from the water. You will have to add minerals back into the water. The advantage is that you can control the water quality.
The water that you have looks to be pretty soft as it is. To put in perspective, when I tested Lake Michigan water versus well water in Chicago the hardness was 150 ppm versus 720 ppm. After the well water was treated by a water softener the hardness went from 720 ppm to 60 ppm. The water was then treated by RO to go to 0 ppm.
Alkalinity for Lake Michigan was 180 ppm compared to well water that was 720 ppm. After the water softener the alkalinity decreased slightly to 630 ppm. The softened water treated by RO dropped to 50 ppm. The conductivity of the well water 990 uS/cm and after RO went down to 37 uS/cm. An RO will produce water in the range of 20-40 uS/cm. This is a very low number. It has no buffering capacity. The alkalinity of your water is about the same as the water after my RO system.
The USGS has a page that shows hardness and alkalinity across the country. It is important to note that surface water tends to be lower in hardness that groundwater since most surface water (i.e. lake) is a bowl that collects water while groundwater has more minerals as rain percolates through the ground. How much minerals is determined by the location. In chicago there is a lot of limestone (calcium carbonate) as compared to New England that is made mostly of granite.
http://water.usgs.gov/owq/hardness-alkalinity.html Final note, usually water is measured as hardness. Hardness is from minerals like calcium carbonate and magnesium carbonate. So if the water has a high hardness then you would expect to see a high alkalinity. carbonate/bicarbonate (which form depends on pH) are what will contribute to alkalinity or buffer capacity.