Inverse Transport With Angularly Averaged Measurements