Setback Calculation on one boundary

Our property touches 3 sides of a neighbor
Our Boundary
Area in 50 and 500 Ft Setback