Text Generation
Transformers
PyTorch
TensorBoard
Safetensors
English
gpt2
Text-Generation
text-generation-inference
Instructions to use SRDdev/ScriptForge with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use SRDdev/ScriptForge with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="SRDdev/ScriptForge")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("SRDdev/ScriptForge") model = AutoModelForCausalLM.from_pretrained("SRDdev/ScriptForge") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use SRDdev/ScriptForge with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "SRDdev/ScriptForge" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SRDdev/ScriptForge", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/SRDdev/ScriptForge
- SGLang
How to use SRDdev/ScriptForge with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "SRDdev/ScriptForge" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SRDdev/ScriptForge", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "SRDdev/ScriptForge" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SRDdev/ScriptForge", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use SRDdev/ScriptForge with Docker Model Runner:
docker model run hf.co/SRDdev/ScriptForge
| license: apache-2.0 | |
| datasets: | |
| - SRDdev/Youtube-Scripts | |
| language: | |
| - en | |
| pipeline_tag: text-generation | |
| widget: | |
| - text: Introduction to Keras ? | |
| example_title: Example 1 | |
| - text: Introduction to Vertex AI Feature Store | |
| exmaple_title: Example 2 | |
| tags: | |
| - Text-Generation | |
| # ScriptForge | |
| ## 🖊️ Model description | |
| ScriptForge is a language model trained on a dataset of 5,000 YouTube videos that explain artificial intelligence (AI) concepts. | |
| ScriptForge is a Causal language transformer. The model resembles the GPT2 architecture, | |
| the model is a Causal Language model meaning it predicts the probability of a sequence of words based on the preceding words in the sequence. | |
| It generates a probability distribution over the next word given the previous words, without incorporating future words. | |
| The goal of ScriptForge is to generate scripts for AI videos that are coherent, informative, and engaging. | |
| This can be useful for content creators who are looking for inspiration or who want to automate the process of generating video scripts. | |
| To use ScriptGPT, users can provide a prompt or a starting sentence, and the model will generate a sequence of words that follow the context and style of the training data. | |
| Models | |
| - [ScriptForge](https://huggingface.co/SRDdev/Script_GPT) : AI content Model | |
| - [ScriptForge-small](https://huggingface.co/SRDdev/ScriptGPT-small) : Generalized Content Model | |
| More models are coming soon... | |
| ## 🛒 Intended uses | |
| The intended uses of ScriptForge include generating scripts for videos that explain artificial intelligence concepts, providing inspiration for content creators, and | |
| automating the process of generating video scripts. | |
| ## 📝 How to use | |
| You can use this model directly with a pipeline for text generation. | |
| 1. __Load Model__ | |
| ```python | |
| from transformers import AutoTokenizer, AutoModelForCausalLM | |
| tokenizer = AutoTokenizer.from_pretrained("SRDdev/ScriptForge") | |
| model = AutoModelForCausalLM.from_pretrained("SRDdev/ScriptForge") | |
| ``` | |
| 2. __Pipeline__ | |
| ```python | |
| from transformers import pipeline | |
| generator = pipeline('text-generation', model= model , tokenizer=tokenizer) | |
| context = "Introduction to Vertex AI Feature Store" | |
| length_to_generate = 200 | |
| script = generator(context, max_length=length_to_generate, do_sample=True)[0]['generated_text'] | |
| ``` | |
| <p style="opacity: 0.8">Keeping the context more technical and related to AI will generate better outputs</p> | |
| ## 🎈Limitations and bias | |
| > The model is trained on Youtube Scripts and will work better for that. It may also generate random information and users should be aware of that and cross-validate the results. | |
| The used is linked [here](https://www.kaggle.com/datasets/jfcaro/5000-transcripts-of-youtube-ai-related-videos) | |
| ## Citations | |
| ``` | |
| @model{ | |
| Name=Shreyas Dixit | |
| framework=Pytorch | |
| Year=Jan 2023 | |
| Pipeline=text-generation | |
| Github=https://github.com/SRDdev | |
| LinkedIn=https://www.linkedin.com/in/srddev | |
| } | |
| ``` |