摘要:
A job scheduler may schedule concurrent distributed jobs in a computer cluster by assigning tasks from the running jobs to compute nodes while balancing fairness with efficiency. Determining which tasks to assign to the compute nodes may be performed using a network flow graph. The weights on at least some of the edges of the graph encode data locality, and the capacities provide constraints that ensure fairness. A min-cost flow technique may be used to perform an assignment of the tasks represented by the network flow graph. Thus, online task scheduling with locality may be mapped onto a network flow graph, which in turn may be used to determine a scheduling assignment using min-cost flow techniques. The costs may encode data locality, fairness, and starvation-freedom.
摘要:
A job scheduler may schedule concurrent distributed jobs in a computer cluster by assigning tasks from the running jobs to compute nodes while balancing fairness with efficiency. Determining which tasks to assign to the compute nodes may be performed using a network flow graph. The weights on at least some of the edges of the graph encode data locality, and the capacities provide constraints that ensure fairness. A min-cost flow technique may be used to perform an assignment of the tasks represented by the network flow graph. Thus, online task scheduling with locality may be mapped onto a network flow graph, which in turn may be used to determine a scheduling assignment using min-cost flow techniques. The costs may encode data locality, fairness, and starvation-freedom.
摘要:
The disclosed embodiments relate generally to the submission of media content to a media distribution system and the generation of media items from the media content. The media items may include, for example, audio, video, image, or podcast data. In accordance with one embodiment, a package for use in generating a downloadable digital media content asset includes metadata content that describes how the media content in a plurality of data files including media content can be processed to generate a downloadable digital media content asset, where the package includes information identifying the plurality of data files.
摘要:
The disclosed embodiments relate generally to the submission of media content to a media distribution system and the generation of media items from the media content. The media items may include, for example, audio, video, image, or podcast data. In accordance with one embodiment, a package for use in generating a downloadable digital media content asset includes metadata content that describes how the media content in a plurality of data files including media content can be processed to generate a downloadable digital media content asset, where the package includes information identifying the plurality of data files.
摘要:
An application programming interface is provided that allows programmers to encapsulate snippets of executable code of a program into accelerator tasks. A graph is generated with a node corresponding to each of the accelerator tasks with edges that represent the data flow and data dependencies between the accelerator tasks. The generated graph is used by a scheduler to schedule the execution of the accelerator tasks across multiple accelerators. The application programming interface further provides an abstraction of the various memories of the accelerators called a datablock. The programmer can store and use data stored on the datablocks without knowing where on the accelerators the data is stored. The application programming interface can further schedule the execution of accelerator tasks to minimize the amount of data that is copied to and from the accelerators based on the datablocks and the generated graph.
摘要:
The disclosed embodiments relate generally to the submission of media content to a media distribution system and the generation of media items from the media content. The media items may include, for example, audio, video, image, or podcast data. In accordance with one embodiment, a package for use in generating a downloadable digital media content asset includes metadata content that describes how the media content in a plurality of data files including media content can be processed to generate a downloadable digital media content asset, where the package includes information identifying the plurality of data files.
摘要:
Providing digital media content is disclosed. A metadata file and a plurality of data files are received. The metadata file is used to process the plurality of data files. The processing of the plurality of data files using the metadata file is performed without human intervention to provide a downloadable digital media content asset.
摘要:
An application programming interface is provided that allows programmers to encapsulate snippets of executable code of a program into accelerator tasks. A graph is generated with a node corresponding to each of the accelerator tasks with edges that represent the data flow and data dependencies between the accelerator tasks. The generated graph is used by a scheduler to schedule the execution of the accelerator tasks across multiple accelerators. The application programming interface further provides an abstraction of the various memories of the accelerators called a datablock. The programmer can store and use data stored on the datablocks without knowing where on the accelerators the data is stored. The application programming interface can further schedule the execution of accelerator tasks to minimize the amount of data that is copied to and from the accelerators based on the datablocks and the generated graph.
摘要:
The disclosed embodiments relate generally to the submission of media content to a media distribution system and the generation of media items from the media content. The media items may include, for example, audio, video, image, or podcast data. In accordance with one embodiment, a package for use in generating a downloadable digital media content asset includes metadata content that describes how the media content in a plurality of data files including media content can be processed to generate a downloadable digital media content asset, where the package includes information identifying the plurality of data files.
摘要:
Providing digital media content is disclosed. A metadata file and a plurality of data files are received. The metadata file is used to process the plurality of data files. The processing of the plurality of data files using the metadata file is performed without human intervention to provide a downloadable digital media content asset.