A telemetry module integrated with an application may include a data collection and analysis engine configured to perform data collection and analysis for reporting to a service associated with the application. The telemetry module may include additional components configured to dynamically scale the data collection and analysis performed by the data collection and analysis engine for a target device such that parameters of the data collection and analysis correspond to resources and capabilities of the target device. For example, a scaling profile manager may receive a profile for a device on which the application is being executed from the service, where the profile defines criteria for the scaling of the data collection and analysis. The scaling profile manager may then determine one or more resources and capabilities of the device, compare the determined resources and capabilities to the criteria, and scale the data collection and analysis based on the comparison.