Set in parkland, Sydney Boys High School is located at Moore Park, just south-east of the City. The school is bounded by Moore Park itself, Anzac Parade, Sydney Girls High School and Cleveland Street.

Vehicular access is via the Cleveland Street gates between the gymnasium and tennis courts. Access via public bus is from Cleveland Street (from Central or Eastern suburbs) or Anzac Parade (from City, Central and South-Eastern suburbs). All school buses pick up and drop off on Anzac Parade.

The school's playing fields (The McKay Sports Ground) are located in Centennial Park near the Robertson Road gates, just a short walk from the school. Games are also played on the Moore Park fields immediately surrounding the school.

The school's rowing sheds (The Outterside Centre) are located at Abbotsford on Teviot Ave, at the end of the Great North Road.