Leveraging transfer learning for efficient results: Practice Questions — Core Machine Learning and AI Knowledge (NVIDIA-Certified Associate: Generative AI LLM)
Practice Questions: Leveraging Transfer Learning for Efficient Results These multiple-choice questions are designed to test your understanding of...
Practice Questions: Leveraging Transfer Learning for Efficient Results
These multiple-choice questions are designed to test your understanding of transfer learning within the context of developing and integrating AI-driven applications using large language models, a key topic for the NVIDIA-Certified Associate: Generative AI LLM exam.
What is the primary advantage of using transfer learning in training deep learning models?
- A. It eliminates the need for any labeled data.
- B. It allows models to leverage pre-trained knowledge to reduce training time and data requirements.
- C. It guarantees 100% accuracy on new tasks.
- D. It only works for image recognition tasks.
Correct Answer: B
Explanation: Transfer learning uses knowledge from a pre-trained model to improve learning efficiency on a related task, reducing the amount of data and time needed.
Which of the following is a common approach when applying transfer learning to a large language model?
- A. Training the entire model from scratch on the new dataset.
- B. Freezing early layers and fine-tuning later layers on the target task.
- C. Removing all pre-trained weights and initializing randomly.
- D. Ignoring the pre-trained model and using only the new data.
Correct Answer: B
Explanation: Early layers capture general features and are often frozen, while later layers are fine-tuned to adapt to the specific target task.
When fine-tuning a pre-trained model for a new task, what is a key consideration to avoid overfitting?
- A. Using a very high learning rate.
- B. Using a small learning rate and possibly early stopping.
- C. Disabling dropout layers.
- D. Increasing the number of training epochs indefinitely.
Correct Answer: B
Explanation: A small learning rate helps preserve learned features while adapting to new data, and early stopping prevents overfitting.
Which scenario best illustrates the effective use of transfer learning?
- A. Training a language model from scratch on a small dataset of medical documents.
- B. Using a pre-trained language model trained on general text and fine-tuning it on medical documents.
- C. Using a pre-trained image recognition model for text classification without modification.
- D. Randomly initializing weights for every new task.
Correct Answer: B
Explanation: Fine-tuning a pre-trained model on domain-specific data leverages existing knowledge and adapts it efficiently.
What is a potential drawback of transfer learning if the source and target tasks are very different?
- A. The model will always perform better than training from scratch.
- B. Negative transfer may occur, reducing performance on the target task.
- C. The model will not train at all.
- D. Transfer learning is not applicable to different tasks.
Correct Answer: B
Explanation: If the source and target domains are too dissimilar, transfer learning can harm performance, known as negative transfer.
Which technique can improve transfer learning effectiveness when adapting a large language model?
- A. Using domain-specific vocabulary and embeddings.
- B. Discarding all pre-trained embeddings.
- C. Training only on unrelated datasets.
- D. Avoiding any form of fine-tuning.
Correct Answer: A
Explanation: Incorporating domain-specific vocabulary helps the model better understand and generate relevant outputs for the target domain.
In transfer learning, what is the role of "feature extraction"?
- A. Training a model from scratch without pre-trained weights.
- B. Using the pre-trained model’s layers to generate features without updating weights.
- C. Randomly initializing weights before training.
- D. Ignoring the pre-trained model entirely.
Correct Answer: B
Explanation: Feature extraction involves using the pre-trained model as a fixed feature generator, typically freezing its weights and training a new classifier on top.
More in this topic
Ready to test your knowledge?
Put what you've learned into practice with a quick quiz and track your progress.
Test your knowledge →