Instructions to use SRDdev/ScriptForge_Plus with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use SRDdev/ScriptForge_Plus with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="SRDdev/ScriptForge_Plus")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("SRDdev/ScriptForge_Plus") model = AutoModelForCausalLM.from_pretrained("SRDdev/ScriptForge_Plus") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use SRDdev/ScriptForge_Plus with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "SRDdev/ScriptForge_Plus" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SRDdev/ScriptForge_Plus", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/SRDdev/ScriptForge_Plus
- SGLang
How to use SRDdev/ScriptForge_Plus with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "SRDdev/ScriptForge_Plus" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SRDdev/ScriptForge_Plus", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "SRDdev/ScriptForge_Plus" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SRDdev/ScriptForge_Plus", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use SRDdev/ScriptForge_Plus with Docker Model Runner:
docker model run hf.co/SRDdev/ScriptForge_Plus
| license: apache-2.0 | |
| language: | |
| - en | |
| pipeline_tag: text-generation | |
| widget: | |
| - text: 10 Meditation Tips | |
| example_title: Health Example | |
| - text: Cooking red sauce pasta | |
| example_title: Cooking Example | |
| - text: Introduction to Keras | |
| example_title: Technology Example | |
| Tags: | |
| - text-generation | |
| metrics: | |
| - accuracy | |
| # ScriptForge_Plus | |
| ## 🖊️ Model description | |
| ScriptForge_Plus is a language model trained on a dataset of 5000 YouTube videos that cover different domains of AI. | |
| ScriptForge_Plus is a Causal language transformer. The model resembles the GPT2 architecture, the model is a Causal Language model meaning it predicts the probability of a sequence of words based on the preceding words in the sequence. | |
| It generates a probability distribution over the next word given the previous words, without incorporating future words. | |
| The goal of ScriptForge_Plus is to generate scripts for Youtube videos that are coherent, informative, and engaging. | |
| This can be useful for content creators who are looking for inspiration or who want to automate the process of generating video scripts. | |
| To use ScriptForge_Plus, users can provide a prompt or a starting sentence, and the model will generate a sequence of words that follow the context and style of the training data. | |
| Models | |
| - [ScriptForge_Plus](https://huggingface.co/SRDdev/ScriptForge_Plus) : AI content Model | |
| - [ScriptForge-small](https://huggingface.co/SRDdev/ScriptForge-medium) : Generalized Content Model | |
| More models are coming soon... | |
| ## 🛒 Intended uses | |
| The intended uses of ScriptForge_Plus include generating scripts for videos, providing inspiration for content creators, and automating the process of generating video scripts. | |
| ## 📝 How to use | |
| You can use this model directly with a pipeline for text generation. | |
| 1. __Load Model__ | |
| ```python | |
| from transformers import AutoTokenizer, AutoModelForCausalLM | |
| tokenizer = AutoTokenizer.from_pretrained("SRDdev/ScriptForge_Plus") | |
| model = AutoModelForCausalLM.from_pretrained("SRDdev/ScriptForge_Plus") | |
| ``` | |
| 2. __Pipeline__ | |
| ```python | |
| from transformers import pipeline | |
| generator = pipeline('text-generation', model= model , tokenizer=tokenizer) | |
| context = "What is Deep Learning" | |
| length_to_generate = 250 | |
| script = generator(context, max_length=length_to_generate, do_sample=True)[0]['generated_text'] | |
| script | |
| ``` | |
| <p style="opacity: 0.8">The model may generate random information as it is still in beta version</p> | |
| ## 🎈Limitations and bias | |
| > The model is trained on Youtube Scripts and will work better for that. It may also generate random information and users should be aware of that and cross-validate the results. | |
| ## Citations | |
| ``` | |
| @model{ | |
| Name=Shreyas Dixit | |
| framework=Pytorch | |
| Year=Jan 2023 | |
| Pipeline=text-generation | |
| Github=https://github.com/SRDdev | |
| LinkedIn=https://www.linkedin.com/in/srddev | |
| } | |
| ``` |