High-Dimensional Statistical Inference From Coarse And Nonlinear Data: Algorithms And Guarantees