diff --git a/.github/PULL_REQUEST_TEMPLATE.md b/.github/PULL_REQUEST_TEMPLATE.md
new file mode 100644
index 00000000..48dff697
--- /dev/null
+++ b/.github/PULL_REQUEST_TEMPLATE.md
@@ -0,0 +1,7 @@
+# What does this PR do?
+
+Fixes # (issue)
+
+## Before submitting
+
+- [ ] Did you read the [contributor guideline](/CONTRIBUTING.md)?
diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md
index 105e8e66..2e495068 100644
--- a/CONTRIBUTING.md
+++ b/CONTRIBUTING.md
@@ -6,7 +6,7 @@ It also helps us if you spread the word! Reference the library in blog posts abo
 
 However you choose to contribute, please be mindful and respect our [code of conduct](CODE_OF_CONDUCT.md).
 
-**This guide was heavily inspired by [transformers guide to contributing](https://github.com/scikit-learn/scikit-learn/blob/main/CONTRIBUTING.md).**
+**This guide was heavily inspired by [transformers guide to contributing](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md).**
 
 ## Ways to contribute