Raise TypeError instead of ValueError for invalid types (#38660)

* Raise TypeError instead of ValueError for invalid types.

* Removed un-necessary changes.

* Resolved conflicts

* Code quality

* Fix failing tests.

* Fix failing tests.

tests/pipelines/test_pipelines_text2text_generation.py

@@ -81,7 +81,7 @@ class Text2TextGenerationPipelineTests(unittest.TestCase):
             ],
         )
 
-        with self.assertRaises(ValueError):
+        with self.assertRaises(TypeError):
             generator(4)
 
     @require_torch