A novel method to synthesize few layer graphene from bulk graphite by mechanical cleavage is presented here. The method involves the use of an ultrasharp single crystal diamond wedge to cleave a highly ordered pyrolytic graphite sample to generate the graphene layers. Cleaving is aided by the use of ultrasonic oscillations along the wedge. Characterization of the obtained layers shows that the process is able to synthesize graphene layers with an area of a few micrometers. Application of oscillation enhances the quality of the layers produced with the layers having a reduced crystallite size as determined from the Raman spectrum. Interesting edge structures are observed that needs further investigation.