Water Quality is one of the most important concerns. The heavy metals levels up to ppb levels in drinking water quality may cause seviour health problems and also cause cancer. In this study we made an attempt to know the concentration of eight heavy metals in ground water and surface water in different locations of Tirupati, Chittoor District, Andhra Pradesh up to ppb levels. For this study 10 water samples (both ground water samples and surface water samples) were collected in February 2012 and preserved by adding of 2-3 drops of nitric acid. These samples were subjected to analysis for eight elements like As, Ni, Cr, Pb, Co, Se, Hg and Cd by using Inductively Coupled Plasma Mass Spectrometry (ICP-MS). ICP-MS is most advanced technique for determination of trace metal concentration up to 1 part per billion (ppb). The concentrations of these metals in the study area were compared with drinking water quality limits given by the World Health Organization (WHO), 4th edition in 2011.