Skip to content
GitLab
Projects
Groups
Snippets
Help
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Docker-in-Docker (DinD) capabilities of public runners deactivated.
More info
Open sidebar
limbra
limbra
Commits
90192b42
Commit
90192b42
authored
Jan 20, 2021
by
LE GAC Renaud
Browse files
Update filter_logs to add protection
parent
8920bf7b
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
0 deletions
+6
-0
modules/harvest_tools/base.py
modules/harvest_tools/base.py
+6
-0
No files found.
modules/harvest_tools/base.py
View file @
90192b42
...
...
@@ -48,9 +48,15 @@ def filter_logs(logs):
list
"""
if
len
(
logs
)
==
0
:
return
logs
data
=
[{
"oais"
:
dct
[
"oais"
]}
for
dct
in
logs
]
df
=
pd
.
DataFrame
(
data
)
if
df
.
empty
:
return
logs
# tag primary OAI as cds or ins
df
[
"first_oai"
]
=
df
.
oais
.
str
.
extract
(
r
"oai:(\w{3})"
,
expand
=
True
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment