organize pipelines by modality (#20306)
This commit is contained in:
@@ -20,31 +20,7 @@ Recognition, Masked Language Modeling, Sentiment Analysis, Feature Extraction an
|
|||||||
There are two categories of pipeline abstractions to be aware about:
|
There are two categories of pipeline abstractions to be aware about:
|
||||||
|
|
||||||
- The [`pipeline`] which is the most powerful object encapsulating all other pipelines.
|
- The [`pipeline`] which is the most powerful object encapsulating all other pipelines.
|
||||||
- The other task-specific pipelines:
|
- Task-specific pipelines are available for [audio](#audio), [computer vision](#computer-vision), [natural language processing](#natural-language-processing), and [multimodal](#multimodal) tasks.
|
||||||
|
|
||||||
- [`AudioClassificationPipeline`]
|
|
||||||
- [`AutomaticSpeechRecognitionPipeline`]
|
|
||||||
- [`ConversationalPipeline`]
|
|
||||||
- [`DepthEstimationPipeline`]
|
|
||||||
- [`DocumentQuestionAnsweringPipeline`]
|
|
||||||
- [`FeatureExtractionPipeline`]
|
|
||||||
- [`FillMaskPipeline`]
|
|
||||||
- [`ImageClassificationPipeline`]
|
|
||||||
- [`ImageSegmentationPipeline`]
|
|
||||||
- [`ImageToTextPipeline`]
|
|
||||||
- [`ObjectDetectionPipeline`]
|
|
||||||
- [`QuestionAnsweringPipeline`]
|
|
||||||
- [`SummarizationPipeline`]
|
|
||||||
- [`TableQuestionAnsweringPipeline`]
|
|
||||||
- [`TextClassificationPipeline`]
|
|
||||||
- [`TextGenerationPipeline`]
|
|
||||||
- [`Text2TextGenerationPipeline`]
|
|
||||||
- [`TokenClassificationPipeline`]
|
|
||||||
- [`TranslationPipeline`]
|
|
||||||
- [`VisualQuestionAnsweringPipeline`]
|
|
||||||
- [`ZeroShotClassificationPipeline`]
|
|
||||||
- [`ZeroShotImageClassificationPipeline`]
|
|
||||||
- [`ZeroShotObjectDetectionPipeline`]
|
|
||||||
|
|
||||||
## The pipeline abstraction
|
## The pipeline abstraction
|
||||||
|
|
||||||
@@ -322,8 +298,9 @@ That should enable you to do all the custom code you want.
|
|||||||
|
|
||||||
[Implementing a new pipeline](../add_new_pipeline)
|
[Implementing a new pipeline](../add_new_pipeline)
|
||||||
|
|
||||||
## The task specific pipelines
|
## Audio
|
||||||
|
|
||||||
|
Pipelines available for audio tasks include the following.
|
||||||
|
|
||||||
### AudioClassificationPipeline
|
### AudioClassificationPipeline
|
||||||
|
|
||||||
@@ -337,36 +314,15 @@ That should enable you to do all the custom code you want.
|
|||||||
- __call__
|
- __call__
|
||||||
- all
|
- all
|
||||||
|
|
||||||
### ConversationalPipeline
|
## Computer vision
|
||||||
|
|
||||||
[[autodoc]] Conversation
|
Pipelines available for computer vision tasks include the following.
|
||||||
|
|
||||||
[[autodoc]] ConversationalPipeline
|
|
||||||
- __call__
|
|
||||||
- all
|
|
||||||
|
|
||||||
### DepthEstimationPipeline
|
### DepthEstimationPipeline
|
||||||
[[autodoc]] DepthEstimationPipeline
|
[[autodoc]] DepthEstimationPipeline
|
||||||
- __call__
|
- __call__
|
||||||
- all
|
- all
|
||||||
|
|
||||||
### DocumentQuestionAnsweringPipeline
|
|
||||||
|
|
||||||
[[autodoc]] DocumentQuestionAnsweringPipeline
|
|
||||||
- __call__
|
|
||||||
- all
|
|
||||||
### FeatureExtractionPipeline
|
|
||||||
|
|
||||||
[[autodoc]] FeatureExtractionPipeline
|
|
||||||
- __call__
|
|
||||||
- all
|
|
||||||
|
|
||||||
### FillMaskPipeline
|
|
||||||
|
|
||||||
[[autodoc]] FillMaskPipeline
|
|
||||||
- __call__
|
|
||||||
- all
|
|
||||||
|
|
||||||
### ImageClassificationPipeline
|
### ImageClassificationPipeline
|
||||||
|
|
||||||
[[autodoc]] ImageClassificationPipeline
|
[[autodoc]] ImageClassificationPipeline
|
||||||
@@ -379,9 +335,39 @@ That should enable you to do all the custom code you want.
|
|||||||
- __call__
|
- __call__
|
||||||
- all
|
- all
|
||||||
|
|
||||||
### ImageToTextPipeline
|
### ObjectDetectionPipeline
|
||||||
|
|
||||||
[[autodoc]] ImageToTextPipeline
|
[[autodoc]] ObjectDetectionPipeline
|
||||||
|
- __call__
|
||||||
|
- all
|
||||||
|
|
||||||
|
### ZeroShotImageClassificationPipeline
|
||||||
|
|
||||||
|
[[autodoc]] ZeroShotImageClassificationPipeline
|
||||||
|
- __call__
|
||||||
|
- all
|
||||||
|
|
||||||
|
### ZeroShotObjectDetectionPipeline
|
||||||
|
|
||||||
|
[[autodoc]] ZeroShotObjectDetectionPipeline
|
||||||
|
- __call__
|
||||||
|
- all
|
||||||
|
|
||||||
|
## Natural Language Processing
|
||||||
|
|
||||||
|
Pipelines available for natural language processing tasks include the following.
|
||||||
|
|
||||||
|
### ConversationalPipeline
|
||||||
|
|
||||||
|
[[autodoc]] Conversation
|
||||||
|
|
||||||
|
[[autodoc]] ConversationalPipeline
|
||||||
|
- __call__
|
||||||
|
- all
|
||||||
|
|
||||||
|
### FillMaskPipeline
|
||||||
|
|
||||||
|
[[autodoc]] FillMaskPipeline
|
||||||
- __call__
|
- __call__
|
||||||
- all
|
- all
|
||||||
|
|
||||||
@@ -391,12 +377,6 @@ That should enable you to do all the custom code you want.
|
|||||||
|
|
||||||
See [`TokenClassificationPipeline`] for all details.
|
See [`TokenClassificationPipeline`] for all details.
|
||||||
|
|
||||||
### ObjectDetectionPipeline
|
|
||||||
|
|
||||||
[[autodoc]] ObjectDetectionPipeline
|
|
||||||
- __call__
|
|
||||||
- all
|
|
||||||
|
|
||||||
### QuestionAnsweringPipeline
|
### QuestionAnsweringPipeline
|
||||||
|
|
||||||
[[autodoc]] QuestionAnsweringPipeline
|
[[autodoc]] QuestionAnsweringPipeline
|
||||||
@@ -444,27 +424,37 @@ See [`TokenClassificationPipeline`] for all details.
|
|||||||
- __call__
|
- __call__
|
||||||
- all
|
- all
|
||||||
|
|
||||||
### VisualQuestionAnsweringPipeline
|
|
||||||
|
|
||||||
[[autodoc]] VisualQuestionAnsweringPipeline
|
|
||||||
- __call__
|
|
||||||
- all
|
|
||||||
|
|
||||||
### ZeroShotClassificationPipeline
|
### ZeroShotClassificationPipeline
|
||||||
|
|
||||||
[[autodoc]] ZeroShotClassificationPipeline
|
[[autodoc]] ZeroShotClassificationPipeline
|
||||||
- __call__
|
- __call__
|
||||||
- all
|
- all
|
||||||
|
|
||||||
### ZeroShotImageClassificationPipeline
|
## Multimodal
|
||||||
|
|
||||||
[[autodoc]] ZeroShotImageClassificationPipeline
|
Pipelines available for multimodal tasks include the following.
|
||||||
|
|
||||||
|
### DocumentQuestionAnsweringPipeline
|
||||||
|
|
||||||
|
[[autodoc]] DocumentQuestionAnsweringPipeline
|
||||||
- __call__
|
- __call__
|
||||||
- all
|
- all
|
||||||
|
|
||||||
### ZeroShotObjectDetectionPipeline
|
### FeatureExtractionPipeline
|
||||||
|
|
||||||
[[autodoc]] ZeroShotObjectDetectionPipeline
|
[[autodoc]] FeatureExtractionPipeline
|
||||||
|
- __call__
|
||||||
|
- all
|
||||||
|
|
||||||
|
### ImageToTextPipeline
|
||||||
|
|
||||||
|
[[autodoc]] ImageToTextPipeline
|
||||||
|
- __call__
|
||||||
|
- all
|
||||||
|
|
||||||
|
### VisualQuestionAnsweringPipeline
|
||||||
|
|
||||||
|
[[autodoc]] VisualQuestionAnsweringPipeline
|
||||||
- __call__
|
- __call__
|
||||||
- all
|
- all
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user