The disclosed embodiments relate to creating a web service composition from a plurality of web services. For creating the web service composition, an augmented definition of the plurality of web services is created. Based on the augmented definition and a user request, a task listing the required inputs for the plurality of web services, the required outputs of the plurality of the web services, the mapping between the output of one service to the input of the second service is computed. The task of identifying the required inputs for the plurality of web services, the required outputs of the plurality of the web services, and the mapping between the output of one service to the input of the second service is crowd sourced to crowd workers who submit their responses to an online crowd sourcing platform. The collected responses are used to generate the desired web service composition.