Notebooks für LC core lessons
This commit is contained in:
Felix Lohmeier
parent
f80bf9b395
commit
9995239f56
|
|
@ -0,0 +1,121 @@
|
||||||
|
{
|
||||||
|
"cells": [
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"# 2. Library Carpentry: Shell"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"<https://librarycarpentry.org/lc-shell/>"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"## Setup"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"### Archiv `shell-lesson.zip` von Library Carpentry herunterladen"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "code",
|
||||||
|
"execution_count": 5,
|
||||||
|
"metadata": {},
|
||||||
|
"outputs": [
|
||||||
|
{
|
||||||
|
"name": "stdout",
|
||||||
|
"output_type": "stream",
|
||||||
|
"text": [
|
||||||
|
"--2019-09-02 20:49:57-- https://librarycarpentry.org/lc-shell/data/shell-lesson.zip\n",
|
||||||
|
"Resolving librarycarpentry.org (librarycarpentry.org)... 185.199.110.153, 185.199.108.153, 185.199.111.153, ...\n",
|
||||||
|
"Connecting to librarycarpentry.org (librarycarpentry.org)|185.199.110.153|:443... connected.\n",
|
||||||
|
"HTTP request sent, awaiting response... 200 OK\n",
|
||||||
|
"Length: 35142014 (34M) [application/zip]\n",
|
||||||
|
"Saving to: ‘shell-lesson.zip’\n",
|
||||||
|
"\n",
|
||||||
|
"shell-lesson.zip 100%[===================>] 33,51M 4,83MB/s in 7,5s \n",
|
||||||
|
"\n",
|
||||||
|
"2019-09-02 20:50:05 (4,46 MB/s) - ‘shell-lesson.zip’ saved [35142014/35142014]\n",
|
||||||
|
"\n"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"source": [
|
||||||
|
"wget https://librarycarpentry.org/lc-shell/data/shell-lesson.zip"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"### Archiv in den Ordner `shell-lesson` entpacken und Archiv löschen"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "code",
|
||||||
|
"execution_count": 8,
|
||||||
|
"metadata": {},
|
||||||
|
"outputs": [
|
||||||
|
{
|
||||||
|
"name": "stdout",
|
||||||
|
"output_type": "stream",
|
||||||
|
"text": [
|
||||||
|
"Archive: shell-lesson.zip\n",
|
||||||
|
" inflating: shell-lesson/000003160_01_text.json \n",
|
||||||
|
" inflating: shell-lesson/2014-01-31_JA-africa.tsv \n",
|
||||||
|
" inflating: shell-lesson/2014-01-31_JA-america.tsv \n",
|
||||||
|
" inflating: shell-lesson/2014-01_JA.tsv \n",
|
||||||
|
" inflating: shell-lesson/2014-02-02_JA-britain.tsv \n",
|
||||||
|
" inflating: shell-lesson/33504-0.txt \n",
|
||||||
|
" inflating: shell-lesson/829-0.txt \n",
|
||||||
|
" inflating: shell-lesson/diary.html \n",
|
||||||
|
" inflating: shell-lesson/pg514.txt \n"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"source": [
|
||||||
|
"unzip shell-lesson.zip -d shell-lesson && rm shell-lesson.zip"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"## Los geht's..."
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "code",
|
||||||
|
"execution_count": null,
|
||||||
|
"metadata": {},
|
||||||
|
"outputs": [],
|
||||||
|
"source": []
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"metadata": {
|
||||||
|
"kernelspec": {
|
||||||
|
"display_name": "Bash",
|
||||||
|
"language": "bash",
|
||||||
|
"name": "bash"
|
||||||
|
},
|
||||||
|
"language_info": {
|
||||||
|
"codemirror_mode": "shell",
|
||||||
|
"file_extension": ".sh",
|
||||||
|
"mimetype": "text/x-sh",
|
||||||
|
"name": "bash"
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"nbformat": 4,
|
||||||
|
"nbformat_minor": 2
|
||||||
|
}
|
||||||
|
|
@ -0,0 +1,178 @@
|
||||||
|
{
|
||||||
|
"cells": [
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"# 3. Library Carpentry: OpenRefine"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"<https://librarycarpentry.org/lc-open-refine/>"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"## Setup"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"### Daten von Library Carpentry herunterladen"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "code",
|
||||||
|
"execution_count": 2,
|
||||||
|
"metadata": {
|
||||||
|
"scrolled": true
|
||||||
|
},
|
||||||
|
"outputs": [
|
||||||
|
{
|
||||||
|
"name": "stdout",
|
||||||
|
"output_type": "stream",
|
||||||
|
"text": [
|
||||||
|
"--2019-09-02 21:00:56-- https://github.com/LibraryCarpentry/lc-open-refine/raw/gh-pages/data/doaj-article-sample.csv\n",
|
||||||
|
"Resolving github.com (github.com)... 140.82.118.4\n",
|
||||||
|
"Connecting to github.com (github.com)|140.82.118.4|:443... connected.\n",
|
||||||
|
"HTTP request sent, awaiting response... 302 Found\n",
|
||||||
|
"Location: https://raw.githubusercontent.com/LibraryCarpentry/lc-open-refine/gh-pages/data/doaj-article-sample.csv [following]\n",
|
||||||
|
"--2019-09-02 21:00:57-- https://raw.githubusercontent.com/LibraryCarpentry/lc-open-refine/gh-pages/data/doaj-article-sample.csv\n",
|
||||||
|
"Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 151.101.112.133\n",
|
||||||
|
"Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|151.101.112.133|:443... connected.\n",
|
||||||
|
"HTTP request sent, awaiting response... 200 OK\n",
|
||||||
|
"Length: 524686 (512K) [text/plain]\n",
|
||||||
|
"Saving to: ‘doaj-article-sample.csv.1’\n",
|
||||||
|
"\n",
|
||||||
|
"doaj-article-sample 100%[===================>] 512,39K 962KB/s in 0,5s \n",
|
||||||
|
"\n",
|
||||||
|
"2019-09-02 21:00:58 (962 KB/s) - ‘doaj-article-sample.csv.1’ saved [524686/524686]\n",
|
||||||
|
"\n"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"source": [
|
||||||
|
"wget https://github.com/LibraryCarpentry/lc-open-refine/raw/gh-pages/data/doaj-article-sample.csv"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"### OpenRefine herunterladen und in den Ordner `openrefine` entpacken"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "code",
|
||||||
|
"execution_count": 4,
|
||||||
|
"metadata": {
|
||||||
|
"scrolled": false
|
||||||
|
},
|
||||||
|
"outputs": [
|
||||||
|
{
|
||||||
|
"name": "stdout",
|
||||||
|
"output_type": "stream",
|
||||||
|
"text": [
|
||||||
|
"--2019-09-02 21:04:31-- https://github.com/OpenRefine/OpenRefine/releases/download/3.2/openrefine-linux-3.2.tar.gz\n",
|
||||||
|
"Resolving github.com (github.com)... 140.82.118.4\n",
|
||||||
|
"Connecting to github.com (github.com)|140.82.118.4|:443... connected.\n",
|
||||||
|
"HTTP request sent, awaiting response... 302 Found\n",
|
||||||
|
"Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/6220644/7dc2a280-afc0-11e9-9a64-d6b401ada2fa?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20190902%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20190902T190447Z&X-Amz-Expires=300&X-Amz-Signature=d35772d3dd43c57298ab8e2c7d28abfddeb5545257175e3bdc33a6f85b62caff&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dopenrefine-linux-3.2.tar.gz&response-content-type=application%2Foctet-stream [following]\n",
|
||||||
|
"--2019-09-02 21:04:32-- https://github-production-release-asset-2e65be.s3.amazonaws.com/6220644/7dc2a280-afc0-11e9-9a64-d6b401ada2fa?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20190902%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20190902T190447Z&X-Amz-Expires=300&X-Amz-Signature=d35772d3dd43c57298ab8e2c7d28abfddeb5545257175e3bdc33a6f85b62caff&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dopenrefine-linux-3.2.tar.gz&response-content-type=application%2Foctet-stream\n",
|
||||||
|
"Resolving github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)... 52.216.238.115\n",
|
||||||
|
"Connecting to github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)|52.216.238.115|:443... connected.\n",
|
||||||
|
"HTTP request sent, awaiting response... 200 OK\n",
|
||||||
|
"Length: 106046195 (101M) [application/octet-stream]\n",
|
||||||
|
"Saving to: ‘openrefine-linux-3.2.tar.gz’\n",
|
||||||
|
"\n",
|
||||||
|
"openrefine-linux-3. 100%[===================>] 101,13M 3,82MB/s in 32s \n",
|
||||||
|
"\n",
|
||||||
|
"2019-09-02 21:05:06 (3,13 MB/s) - ‘openrefine-linux-3.2.tar.gz’ saved [106046195/106046195]\n",
|
||||||
|
"\n",
|
||||||
|
"Total bytes read: 125419520 (120MiB, 137MiB/s)\n"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"source": [
|
||||||
|
"wget https://github.com/OpenRefine/OpenRefine/releases/download/3.2/openrefine-linux-3.2.tar.gz\n",
|
||||||
|
"mkdir -p openrefine\n",
|
||||||
|
"tar -xzf openrefine-linux-3.2.tar.gz -C openrefine --strip 1 --totals\n",
|
||||||
|
"rm openrefine-linux-3.2.tar.gz"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"### OpenRefine starten (die Adresse http://127.0.0.1:3333 öffnet sich automatisch im Browser)"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "code",
|
||||||
|
"execution_count": null,
|
||||||
|
"metadata": {
|
||||||
|
"scrolled": false
|
||||||
|
},
|
||||||
|
"outputs": [
|
||||||
|
{
|
||||||
|
"name": "stdout",
|
||||||
|
"output_type": "stream",
|
||||||
|
"text": [
|
||||||
|
"You have 15961M of free memory.\n",
|
||||||
|
"Your current configuration is set to use 1400M of memory.\n",
|
||||||
|
"OpenRefine can run better when given more memory. Read our FAQ on how to allocate more memory here:\n",
|
||||||
|
"https://github.com/OpenRefine/OpenRefine/wiki/FAQ:-Allocate-More-Memory\n",
|
||||||
|
"Starting OpenRefine at 'http://127.0.0.1:3333/'\n",
|
||||||
|
"\n",
|
||||||
|
"21:07:41.809 [ refine_server] Starting Server bound to '127.0.0.1:3333' (0ms)\n",
|
||||||
|
"21:07:41.810 [ refine_server] refine.memory size: 1400M JVM Max heap: 1407188992 (1ms)\n",
|
||||||
|
"21:07:41.819 [ refine_server] Initializing context: '/' from '/home/felix/notebooks/openrefine/webapp' (9ms)\n",
|
||||||
|
"SLF4J: Class path contains multiple SLF4J bindings.\n",
|
||||||
|
"SLF4J: Found binding in [jar:file:/home/felix/notebooks/openrefine/server/target/lib/slf4j-log4j12-1.7.18.jar!/org/slf4j/impl/StaticLoggerBinder.class]\n",
|
||||||
|
"SLF4J: Found binding in [jar:file:/home/felix/notebooks/openrefine/webapp/WEB-INF/lib/slf4j-log4j12-1.7.18.jar!/org/slf4j/impl/StaticLoggerBinder.class]\n",
|
||||||
|
"SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.\n",
|
||||||
|
"SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]\n",
|
||||||
|
"21:07:42.268 [ refine] Starting OpenRefine 3.2 [55c921b]... (449ms)\n",
|
||||||
|
"21:07:42.268 [ refine] initializing FileProjectManager with dir (0ms)\n",
|
||||||
|
"21:07:42.268 [ refine] /home/felix/.local/share/openrefine (0ms)\n",
|
||||||
|
"21:07:47.059 [ refine] POST /command/core/load-language (4791ms)\n",
|
||||||
|
"21:07:47.083 [ refine] GET /command/core/get-preference (24ms)\n",
|
||||||
|
"21:07:47.096 [ refine] POST /command/core/load-language (13ms)\n",
|
||||||
|
"21:07:47.104 [ refine] POST /command/core/load-language (8ms)\n",
|
||||||
|
"21:07:47.188 [ refine] POST /command/core/get-importing-configuration (84ms)\n",
|
||||||
|
"21:07:47.216 [ refine] GET /command/core/get-all-project-tags (28ms)\n",
|
||||||
|
"21:07:47.229 [ refine] GET /command/core/get-all-project-metadata (13ms)\n",
|
||||||
|
"21:07:47.348 [ refine] GET /command/core/get-languages (119ms)\n",
|
||||||
|
"21:07:47.447 [ refine] GET /command/database/saved-connection (99ms)\n",
|
||||||
|
"21:07:47.489 [ refine] GET /command/core/get-version (42ms)\n"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"source": [
|
||||||
|
"openrefine/refine"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"metadata": {
|
||||||
|
"kernelspec": {
|
||||||
|
"display_name": "Bash",
|
||||||
|
"language": "bash",
|
||||||
|
"name": "bash"
|
||||||
|
},
|
||||||
|
"language_info": {
|
||||||
|
"codemirror_mode": "shell",
|
||||||
|
"file_extension": ".sh",
|
||||||
|
"mimetype": "text/x-sh",
|
||||||
|
"name": "bash"
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"nbformat": 4,
|
||||||
|
"nbformat_minor": 2
|
||||||
|
}
|
||||||
|
|
@ -0,0 +1,87 @@
|
||||||
|
{
|
||||||
|
"cells": [
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"# 4. Library Carpentry: Git"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"<https://librarycarpentry.org/lc-git/>"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"## Setup"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"### Account bei GitHub einrichten"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"Für diese Lehreinheit benötigen Sie einen kostenlosen Account bei GitHub. Bitte registrieren Sie sich unter <https://github.com/join>."
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"### Git konfigurieren\n",
|
||||||
|
"\n",
|
||||||
|
"Ergänzen Sie zwischen den Anführungsstrichen ihren Namen bzw. ihre E-Mail-Adresse, mit der Sie sich bei GitHub registriert haben."
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "code",
|
||||||
|
"execution_count": 1,
|
||||||
|
"metadata": {},
|
||||||
|
"outputs": [],
|
||||||
|
"source": [
|
||||||
|
"git config --global user.name \"\"\n",
|
||||||
|
"git config --global user.email \"\""
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"## Los geht's..."
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "code",
|
||||||
|
"execution_count": null,
|
||||||
|
"metadata": {},
|
||||||
|
"outputs": [],
|
||||||
|
"source": []
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"metadata": {
|
||||||
|
"kernelspec": {
|
||||||
|
"display_name": "Bash",
|
||||||
|
"language": "bash",
|
||||||
|
"name": "bash"
|
||||||
|
},
|
||||||
|
"language_info": {
|
||||||
|
"codemirror_mode": "shell",
|
||||||
|
"file_extension": ".sh",
|
||||||
|
"mimetype": "text/x-sh",
|
||||||
|
"name": "bash"
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"nbformat": 4,
|
||||||
|
"nbformat_minor": 2
|
||||||
|
}
|
||||||
Loading…
Reference in New Issue