profile
viewpoint

shankerwangmiao/continuation 0

A compiler for JavaScript asynchronous Continuation-Passing Style transformation

shankerwangmiao/danmaku2ass 0

Convert comments from Niconico/AcFun/bilibili to ASS format

issue commenttuna/issues

Manjaro-cd镜像为空

应该可以把首页的 manjaro-cd 删掉

issaccv

comment created time in 4 hours

issue closedtuna/issues

[BFSU] 特定包在 bfsu 的 pypi 为 404, tuna 正常

先决条件 (Prerequisites)

  • [X] 我已确认这个问题没有在其他 issues中提出过。 I am sure that this problem has NEVER been discussed in other issues.

发生了什么(What happened)

https://mirrors.bfsu.edu.cn/pypi/web/simple/aiosmtplib/ https://mirrors.bfsu.edu.cn/pypi/web/packages/02/53/d67f5e2cf8d46bed77ce823a4bac3f4be56e91dde37036e1e76046bd60c1/aiosmtplib-1.1.6.tar.gz#sha256=d138fe6ffecbc9e6320269690b9ac0b75e540ef96e8f5c77d4a306760014dce2

aiosmtplib 在 bsft 无法正常下载,

https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple/aiosmtplib/ https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/02/53/d67f5e2cf8d46bed77ce823a4bac3f4be56e91dde37036e1e76046bd60c1/aiosmtplib-1.1.6.tar.gz#sha256=d138fe6ffecbc9e6320269690b9ac0b75e540ef96e8f5c77d4a306760014dce2

tuna 正常

期望的现象(What you expected to happen)

正常下载

如何重现此问题(How to reproduce it)

curl https://mirrors.bfsu.edu.cn/pypi/web/packages/02/53/d67f5e2cf8d46bed77ce823a4bac3f4be56e91dde37036e1e76046bd60c1/aiosmtplib-1.1.6.tar.gz

操作系统(OS Version)

No response

浏览器(如果适用)(Browser version, if applicable)

No response

其他环境(Other environments)

No response

其他需要说明的事项(Anything else we need to know)

No response

closed time in 2 days

rmb122

issue commenttuna/issues

[BFSU] 特定包在 bfsu 的 pypi 为 404, tuna 正常

已经处理完毕。

rmb122

comment created time in 2 days

issue closedtuna/mirror-web

nginx的git库服务提供问题

有两个问题

  1. git形式的镜像库都以git路径为前缀,后端以git-http-backend提供服务,nginx上我通过下面这样的设置可以实现
location ~ /git(/.*) {
      fastcgi_pass unix:/var/run/fcgiwrap.socket;
      fastcgi_param SCRIPT_FILENAME /usr/lib/git-core/git-http-backend;
      fastcgi_param GIT_HTTP_EXPORT_ALL "";
      fastcgi_param GIT_PROJECT_ROOT /var/tunasync/;
      fastcgi_param PATH_INFO $1;
      include /etc/nginx/fastcgi_params;
    }

但是有看到网上说应该区分静态文件直接nginx提供服务,这样性能可以更好,只有git相关文件才需要传递给git-http-backend。但是不知道如何区分呢?

  1. git-repo这个库镜像站提供这样的下载初始化脚本是怎么实现的?这个路径并不是真实存在的(实际内容在/git/git-repo/git-repo)而且与仓库地址完全相同 curl https://mirrors.bfsu.edu.cn/git/git-repo -o repo 即使我手动改成curl https://xxxx.com/git/git-repo/git-repo -o repo似乎也获取不了/git/git-repo/git-repo这个文件 2022/01/14 07:42:34 [error] 1547952#1547952: *4 FastCGI sent in stderr: "Request not supported: '/var/tunasync/git-repo/git-repo'" while reading response header from upstream, client: x.x.x.x, server: _, request: "GET /git/git-repo/git-repo HTTP/1.1", upstream: "fastcgi://unix:/var/run/fcgiwrap.socket:", host: "xxxx.com"

不知以上两个问题能否直接提供一下nginx的配置参考呢?感谢

closed time in 4 days

nightcoffee

issue commenttuna/mirror-web

nginx的git库服务提供问题

有两个问题

  1. git形式的镜像库都以git路径为前缀,后端以git-http-backend提供服务,nginx上我通过下面这样的设置可以实现
location ~ /git(/.*) {
      fastcgi_pass unix:/var/run/fcgiwrap.socket;
      fastcgi_param SCRIPT_FILENAME /usr/lib/git-core/git-http-backend;
      fastcgi_param GIT_HTTP_EXPORT_ALL "";
      fastcgi_param GIT_PROJECT_ROOT /var/tunasync/;
      fastcgi_param PATH_INFO $1;
      include /etc/nginx/fastcgi_params;
    }

但是有看到网上说应该区分静态文件直接nginx提供服务,这样性能可以更好,只有git相关文件才需要传递给git-http-backend。但是不知道如何区分呢?

/git 目录下不存在需要服务的静态文件

  1. git-repo这个库镜像站提供这样的下载初始化脚本是怎么实现的?这个路径并不是真实存在的(实际内容在/git/git-repo/git-repo)而且与仓库地址完全相同 curl https://mirrors.bfsu.edu.cn/git/git-repo -o repo 即使我手动改成curl https://xxxx.com/git/git-repo/git-repo -o repo似乎也获取不了/git/git-repo/git-repo这个文件 2022/01/14 07:42:34 [error] 1547952#1547952: *4 FastCGI sent in stderr: "Request not supported: '/var/tunasync/git-repo/git-repo'" while reading response header from upstream, client: x.x.x.x, server: _, request: "GET /git/git-repo/git-repo HTTP/1.1", upstream: "fastcgi://unix:/var/run/fcgiwrap.socket:", host: "xxxx.com"

在配置中 Hack 了一下:

location = /git/git-repo {
        alias /path/to/git-repo/git-repo;
}

不知以上两个问题能否直接提供一下nginx的配置参考呢?感谢

nightcoffee

comment created time in 4 days

pull request commenttuna/mirror-web

Update ROS2 Document

不指定 arch 时,会自动获取所声明的架构的包,包括 dpkg --print-foreign-architecturesdpkg --print-architecture。如果出现了 404 错误,意味着用户开启了 i386 架构。这样的 404 错误不会影响使用。

lss233

comment created time in 6 days

issue closedtuna/issues

[镜像请求]

先决条件 (Prerequisites)

  • [X] 我已确认这个镜像源从未在 其他 issues 中讨论过。 I am sure that this repo has NEVER been discussed in other issues.

  • [X] 我已确认这个镜像源没有我选择的镜像站上线。 I am sure that this repo has NOT currently be provided by the sites I select.

  • [X] 我已仔细阅读 请求新镜像前必读(试行)。 I have CAREFULLY read the mirroring rules.

项目名称与简介 (Project introduction)

ububtu50.10 5.8.0-63

上游地址与镜像方法 (How to mirror)

不清楚

镜像大小 (Mirror size)

No response

备注 (Note)

No response

期望上线的镜像站 (Expected mirroring sites)

  • [X] TUNA - https://mirrors.tuna.tsinghua.edu.cn
  • [X] BFSU - https://mirrors.bfsu.edu.cn
  • [X] OpenTUNA - https://opentuna.cn

closed time in 9 days

wozuishuai997

issue commenttuna/issues

[镜像请求]

Ubuntu 20.10 是 Ubuntu 的短期支持版,其支持期限是 1 年。也就是说,到 21 年 10 月份,其软件仓库就不再更新和维护,并随后会被移除。

如果您需要安装软件,您可以直接使用 old-releases 镜像。如果您需要更新系统上已有的软件,建议您等到 4 月份后直接更新 22.04 长期支持版。

wozuishuai997

comment created time in 9 days

issue commentjenkins-infra/helpdesk

Docker | Plugins Installation | First time setup

Hi, according to the packets captured, I can conclude that your issue has no relevance with TUNA mirror site or Jenkins infrastructure. Your TLS connection to TUNA mirror site and DNS resolution is hijacked, and that's why Jenkins would complain about the error of certificate chain. You need to contact your network administrator.

Thanks @shankerwangmiao for the investigation and from it I could sense that is something network specific on the client but I am not able to understand how @dduportal was able to reproduce the issue, also I tried to do some insight analysis, so (Before this everything was without using any VPN and proxies), now I could see while I was on VPN configuration provided by my organization which is for Herzo (EU) and @dduportal has a Belgium ISP (EU) can we correlate these two scenarios ?, also my organization also provided a VPN configuration for China (I tried that since mirror we are referring is based on China) , when I tried this VPN config and ran the container which gave the following error which affirms it could be something at my network administration policies but is there something else which we might be missing ?

Error while using China VPN config


java.net.UnknownHostException: get.jenkins.io

I will however probe this with network team here.

Negative, your issue is apparently related to your organization. I believe the two issues are independent.

backtrackshubham

comment created time in 11 days

issue closedtuna/issues

网页无法打开

先决条件 (Prerequisites)

  • [X] 我已确认这个问题没有在其他 issues中提出过。 I am sure that this problem has NEVER been discussed in other issues.

发生了什么(What happened)

https://mirrors.tuna.tsinghua.edu.cn/anaconda/anaconda 网页无法打开

期望的现象(What you expected to happen)

网页可以正常访问

如何重现此问题(How to reproduce it)

https://mirrors.tuna.tsinghua.edu.cn/anaconda/anaconda 网页无法打开

操作系统(OS Version)

No response

浏览器(如果适用)(Browser version, if applicable)

No response

其他环境(Other environments)

No response

其他需要说明的事项(Anything else we need to know)

No response

closed time in 12 days

Gisele515

issue commentjenkins-infra/helpdesk

Docker | Plugins Installation | First time setup

Hi, according to the packets captured, I can conclude that your issue has no relevance with TUNA mirror site or Jenkins infrastructure. Your TLS connection to TUNA mirror site and DNS resolution is hijacked, and that's why Jenkins would complain about the error of certificate chain. You need to contact your network administrator.

backtrackshubham

comment created time in 12 days

issue commentjenkins-infra/helpdesk

Docker | Plugins Installation | First time setup

Can you provide a packet capture in that container?

Packet capture can be done via:

apt update && apt install -y tcpdump
# just before reproduce the ssl issue
tcpdump -i eth0 -w /tmp/1.pcap &
# then run
java HttpDownloadUtility.java
# and send tcpdump to foreground can stop capture
fg
(Press Ctrl-C)
# copy  /tmp/1.pcap out and upload here
backtrackshubham

comment created time in 12 days

issue commentjenkins-infra/helpdesk

Docker | Plugins Installation | First time setup

Can you provide the exact hash and tag of the image where the error is generated so that we can be on the same page.

backtrackshubham

comment created time in 12 days

issue commentjenkins-infra/helpdesk

Docker | Plugins Installation | First time setup

According to the access log analysis, we are providing 680k reqs and 823.6GB data per day on average in recent 7 days. 99% of the responses are normal 200. I have not seen any abnormal change on the traffic.

backtrackshubham

comment created time in 12 days

issue commentjenkins-infra/helpdesk

Docker | Plugins Installation | First time setup

The image I used is

jenkins/jenkins                                lts-alpine-jdk11           8ca0142efac4        5 weeks ago         260MB
backtrackshubham

comment created time in 12 days

issue commentjenkins-infra/helpdesk

Docker | Plugins Installation | First time setup

Can anyone provide a packet capture? I tried but failed to reproduce the problem. The installation of recommended plugins run smoothly.

backtrackshubham

comment created time in 12 days

issue commentjenkins-infra/helpdesk

Docker | Plugins Installation | First time setup

Hi, all. I'm the admin of TUNA mirror site. According to my experience, it is probably related to the certificate by Let's Encrypt.

backtrackshubham

comment created time in 12 days

issue closedtuna/issues

OrangePi One的armbian系统镜像找不到

先决条件 (Prerequisites)

  • [X] 我已确认这个问题没有在其他 issues中提出过。 I am sure that this problem has NEVER been discussed in other issues.

发生了什么(What happened)

orangepi one的armbian镜像似乎不见了?不论是focal还是bullseye,跳转到的链接均显示404,从镜像站的获取安装镜像处也找不到orangepi one的armbian。

期望的现象(What you expected to happen)

能正常地跳转到镜像站下载到系统镜像

如何重现此问题(How to reproduce it)

https://www.armbian.com/orange-pi-one/ 从armbian官网该开发板页下载镜像

操作系统(OS Version)

No response

浏览器(如果适用)(Browser version, if applicable)

No response

其他环境(Other environments)

No response

其他需要说明的事项(Anything else we need to know)

No response

closed time in 16 days

kaidegit

issue commenttuna/issues

OrangePi One的armbian系统镜像找不到

经查,上游及其它镜像站上也没有此文件。这些文件可能已经被官方移除。

您可以从官方的历史归档中查找您需要的文件:https://armbian.hosthatch.com/archive/orangepione/archive/

kaidegit

comment created time in 16 days

issue commenttuna/tunasync

bug: shell file is not mapped into docker volume while using "command provider"

Bandersnatch relies on xml-rpc interface provided by official pypi.org, and as a result cannot sync pypi repository from an alternative source. However, in its latest release, a new config is added entitled download-mirror, to fetch package metadata from the rpc interface on pypi.org and actual packages from an alternative source.

r00t1900

comment created time in 17 days

issue closedtuna/tunasync

bug: shell file is not mapped into docker volume while using "command provider"

Env

  • tunasync: 0.8.0
  • tunasynctl: 0.8.0
  • tunasync-scripts: master@7817785
  • system: debian 10
  • arch: amd64
  • docker: 20.10.9
  • tunathu/bandersnatch: latest

Description

tunasync can not run custom shell file with proper path:

tunasync worker -c worker.conf -v --debug:

[22-01-01 11:06:18][DEBUG][runner.go:53] volume: /tmp/tunasync/pypi:/tmp/tunasync/pypi                                        
[22-01-01 11:06:18][DEBUG][runner.go:127] Command start: [docker run --rm -a STDOUT -a STDERR --name tunasync-job-pypi -w /tmp
/tunasync/pypi -u 0:0 -v /tmp/tunasync/log/tunasync/pypi:/tmp/tunasync/log/tunasync/pypi -v /tmp/tunasync/log/tunasync/pypi/py
pi_2022-01-01_11_06.log:/tmp/tunasync/log/tunasync/pypi/pypi_2022-01-01_11_06.log -v /tmp/tunasync/pypi:/tmp/tunasync/pypi -e 
TUNASYNC_MIRROR_NAME=pypi -e TUNASYNC_WORKING_DIR=/tmp/tunasync/pypi -e TUNASYNC_UPSTREAM_URL=https://pypi.python.org/ -e TUNA
SYNC_LOG_DIR=/tmp/tunasync/log/tunasync/pypi -e TUNASYNC_LOG_FILE=/tmp/tunasync/log/tunasync/pypi/pypi_2022-01-01_11_06.log tunathu/bandersnatch:latest /home/scripts/pypi.sh]
[22-01-01 11:06:18][DEBUG][cmd_provider.go:145] set isRunning to true: pypi                                                   
[22-01-01 11:06:18][DEBUG][base_provider.go:168] calling Wait: pypi                                                          
[22-01-01 11:06:18][DEBUG][job.go:169] provider started                                                                 
[22-01-01 11:06:18][DEBUG][worker.go:469] reporting on manager url: http://localhost:12345/workers/test_worker/schedules      
[22-01-01 11:06:18][DEBUG][worker.go:448] reporting on manager url: http://localhost:12345/workers/test_worker/jobs/pypi      
[22-01-01 11:06:18][DEBUG][worker.go:469] reporting on manager url: http://localhost:12345/workers/test_worker/schedules
[22-01-01 11:06:18][DEBUG][base_provider.go:165] set isRunning to false: pypi
[22-01-01 11:06:18][DEBUG][job.go:180] syncing done
[22-01-01 11:06:18][WARNIN][job.go:213] failed syncing pypi: exit status 127
[22-01-01 11:06:18][DEBUG][job.go:215] post-fail hooks

/tmp/tunasync/log/tunasync/pypi/pypi_2022-01-01_11_06.log:

root@tuna-docker-supported:~# cat /tmp/tunasync/log/tunasync/pypi/pypi_2022-01-01_11_20.log.fail                        
docker: Error response from daemon: OCI runtime create failed: container_linux.go:380: starting container process caused: exec
: "/home/scripts/pypi.sh": stat /home/scripts/pypi.sh: no such file or directory: unknown.                          
time="2022-01-01T11:20:33+08:00" level=error msg="error waiting for container: context canceled"

Analysis

According to these debug information, I noticed that the docker commands did not map pypi.sh into docker filesystem, which might be the reason of no such file or directory.

Solution

I try to append -v /home/scripts/pypi.sh:/home/scripts/pypi.sh to the docker commands and then manually execute it, and it shows that it works well:

docker run --rm -a STDOUT -a STDERR --name tunasync-job-pypi -w /tmp/tunasync/pypi -u 0:0 \
# add this below volume mapping args
-v /home/scripts/pypi.sh:/home/scripts/pypi.sh \
-v /tmp/tunasync/log/tunasync/pypi:/tmp/tunasync/log/tunasync/pypi \
-v /tmp/tunasync/log/tunasync/pypi/pypi_2022-01-01_11_06.log:/tmp/tunasync/log/tunasync/pypi/pypi_2022-01-01_11_06.log \
-v /tmp/tunasync/pypi:/tmp/tunasync/pypi \
-e TUNASYNC_MIRROR_NAME=pypi \
-e TUNASYNC_WORKING_DIR=/tmp/tunasync/pypi \
-e TUNASYNC_UPSTREAM_URL=https://pypi.python.org/ \
-e TUNASYNC_LOG_DIR=/tmp/tunasync/log/tunasync/pypi \
-e TUNASYNC_LOG_FILE=/tmp/tunasync/log/tunasync/pypi/pypi_2022-01-01_11_06.log \
tunathu/bandersnatch:latest /home/scripts/pypi.sh

command output:

Syncing to /tmp/tunasync/pypi
2022-01-01 04:06:26,421 INFO: Selected storage backend: filesystem (configuration.py:128)
2022-01-01 04:06:26,421 INFO: Selected compare method: stat (configuration.py:174)
2022-01-01 04:06:26,740 INFO: Initialized project plugin allowlist_project, filtering ['tf-nightly-cpu'] (allowlist_name.py:31
)
2022-01-01 04:06:26,744 INFO: Initialized project plugin blocklist_project, filtering [] (blocklist_name.py:27)
2022-01-01 04:06:26,800 INFO: Status file /tmp/tunasync/pypi/status missing. Starting over. (mirror.py:601)
2022-01-01 04:06:26,800 INFO: Syncing with https://pypi.python.org/. (mirror.py:56)
2022-01-01 04:06:26,800 INFO: Current mirror serial: 0 (mirror.py:267)
2022-01-01 04:06:26,800 INFO: Syncing all packages. (mirror.py:282)
2022-01-01 04:06:43,845 INFO: Package 'tf-nightly-cpu' is allowlisted (allowlist_name.py:88)                                 
2022-01-01 04:06:43,955 INFO: Trying to reach serial: 12451048 (mirror.py:299)                                               
2022-01-01 04:06:43,955 INFO: 1 packages to sync. (mirror.py:301)                                                            
2022-01-01 04:06:43,978 INFO: No metadata filters are enabled. Skipping metadata filtering (mirror.py:75)                    
2022-01-01 04:06:43,978 INFO: No release filters are enabled. Skipping release filtering (mirror.py:77)                      
2022-01-01 04:06:43,978 INFO: No release file filters are enabled. Skipping release file filtering (mirror.py:79)            
2022-01-01 04:06:43,981 INFO: Fetching metadata for package: tf-nightly-cpu (serial 12447857) (package.py:57)                
2022-01-01 04:06:44,648 INFO: Downloading: https://files.pythonhosted.org/packages/46/2a/07af15a0d8ca3f75a53621dab60f92f72d704
6c511dbeeee303cb947b187/tf_nightly_cpu-2.7.0.dev20210701-cp36-cp36m-macosx_10_14_x86_64.whl (mirror.py:933)

Further

  • Why we need to manually add this mapping? And how the current mirror web is running? Whether this is a bug or not?
  • Can we just change upstream from https://pypi.org to https://pypi.tuna.tsinghua.edu.cn? We try to boost our mirroring speed rate but receive these error:
  File "/usr/local/lib/python3.9/site-packages/bandersnatch/master.py", line 216, in rpc                                                                              
    return await method()  File "/usr/local/lib/python3.9/site-packages/aiohttp_xmlrpc/client.py", line 121, in __remote_call                                                                  
    return self._parse_response((await response.read()), method_name)  File "/usr/local/lib/python3.9/site-packages/aiohttp_xmlrpc/client.py", line 82, in _parse_response                                                                 
    response = etree.fromstring(body, parser)
  File "src/lxml/etree.pyx", line 3252, in lxml.etree.fromstring
  File "src/lxml/parser.pxi", line 1912, in lxml.etree._parseMemoryDocument
  File "src/lxml/parser.pxi", line 1800, in lxml.etree._parseDoc  File "src/lxml/parser.pxi", line 1141, in lxml.etree._BaseParser._parseDoc
  File "src/lxml/parser.pxi", line 615, in lxml.etree._ParserContext._handleParseResultDoc                                                                              File "src/lxml/parser.pxi", line 725, in lxml.etree._handleParseResult
  File "src/lxml/parser.pxi", line 654, in lxml.etree._raiseParseError
  File "<string>", line 7lxml.etree.XMLSyntaxError: Opening and ending tag mismatch: meta line 5 and head, line 7, column 8

worker.conf:

[global]
name = "test_worker"
log_dir = "/tmp/tunasync/log/tunasync/{{.Name}}"
mirror_dir = "/tmp/tunasync"
concurrent = 10
interval = 1

[docker]
enable = true

[manager]
api_base = "http://localhost:12345"
token = ""
ca_cert = ""

[cgroup]
enable = false
base_path = "/sys/fs/cgroup"
group = "tunasync"

[server]
hostname = "localhost"
listen_addr = "127.0.0.1"
listen_port = 6000
ssl_cert = ""
ssl_key = ""

[[mirrors]]
name = "pypi"
provider = "command"
upstream = "https://pypi.tuna.tsinghua.edu.cn/"
command = "/home/scripts/pypi.sh"
docker_image = "tunathu/bandersnatch:latest"
interval = 5

manger.conf:

debug = false

[server]
addr = "127.0.0.1"
port = 12345
ssl_cert = ""
ssl_key = ""

[files]
db_type = "bolt"
db_file = "/tmp/tunasync/manager.db"
ca_cert = ""

/home/scripts/pypi.sh:

#!/bin/bash
set -e
BANDERSNATCH=${BANDERSNATCH:-"/usr/local/bin/bandersnatch"}
TUNASYNC_UPSTREAM=${TUNASYNC_UPSTREAM_URL:-"https://pypi.tuna.tsinghua.edu.cn/"}
CONF="/tmp/bandersnatch.conf"
INIT=${INIT:-"0"}

if [ ! -d "$TUNASYNC_WORKING_DIR" ]; then
        mkdir -p $TUNASYNC_WORKING_DIR
        INIT="1"
fi

echo "Syncing to $TUNASYNC_WORKING_DIR"

if [[ $INIT == "0" ]]; then
(
        cat << EOF
[mirror]
directory = ${TUNASYNC_WORKING_DIR}
master = ${TUNASYNC_UPSTREAM}
json = true
timeout = 300
workers = 5
hash-index = false
stop-on-error = false
delete-packages = true
compare-method = stat

[plugins]
enabled =
    blocklist_project
    allowlist_project

[allowlist]
packages =
    tf-nightly-cpu
EOF
        for i in $PYPI_EXCLUDE; do
                echo "    $i"
        done
) > $CONF
        exec $BANDERSNATCH -c $CONF mirror 
else
        cat > $CONF << EOF
[mirror]
directory = ${TUNASYNC_WORKING_DIR}
master = ${TUNASYNC_UPSTREAM}
json = true
timeout = 15
workers = 10
hash-index = false
stop-on-error = false
delete-packages = false
EOF

        exec $BANDERSNATCH -c $CONF mirror
fi

Thanks for viewing.

closed time in 17 days

r00t1900

issue commenttuna/tunasync

bug: shell file is not mapped into docker volume while using "command provider"

Your analysis is correct. It is not a bug but a feature, because tunasync does not know how to setup the mapping. Actually, the script configured in command field is executed in the docker image. It can be directly built into the image or mapped from other location. The mapping can be declared in the [docker] section so that no repeated separated config is needed. For example:

[docker]
volumes = [
        "/path/to/tunasync-scripts:/home/scripts:ro",
]

[[mirrors]]
name = "foo"
provider = "command"
upstream = "xxxxx"
command = "/home/scripts/foo.sh"
docker_image = "foo_image:latest"
docker_volumes = [
  "/path/to/additional_volume1:/path/to/mountpoint:ro",
  "/path/to/additional_volume2:/path/to/mountpoint2:ro"
]
r00t1900

comment created time in 17 days

issue commenttuna/issues

网页无法打开

请您直接将文件内容粘贴上来,同时提供完整的执行的命令和命令的输出。

Gisele515

comment created time in 19 days

issue commenttuna/issues

网页无法打开

请在 github 的页面上上传 conda_env_vggish.yml

Gisele515

comment created time in 19 days

issue closedtuna/issues

Wget下载CentOS ISO显示403 Forbidden

先决条件 (Prerequisites)

  • [X] 我已确认这个问题没有在其他 issues中提出过。 I am sure that this problem has NEVER been discussed in other issues.

发生了什么(What happened)

使用Wget命令行工具下载CentOS ISO镜像时显示403 Forbidden,但使用浏览器下载时正常。 试了下Debian、Ubuntu正常,但CentOS异常(CentOS 7, 8均不行)

$ wget -d 'https://mirrors.tuna.tsinghua.edu.cn/centos/8.5.2111/isos/x86_64/CentOS-8.5.2111-x86_64-dvd1.iso'
DEBUG output created by Wget 1.21 on linux-gnu.

Reading HSTS entries from /home/zby/.wget-hsts
URI encoding = “UTF-8”
Converted file name 'CentOS-8.5.2111-x86_64-dvd1.iso' (UTF-8) -> 'CentOS-8.5.2111-x86_64-dvd1.iso' (UTF-8)
--2021-12-19 16:34:53--  https://mirrors.tuna.tsinghua.edu.cn/centos/8.5.2111/isos/x86_64/CentOS-8.5.2111-x86_64-dvd1.iso
Certificates loaded: 129
正在解析主机 mirrors.tuna.tsinghua.edu.cn (mirrors.tuna.tsinghua.edu.cn)... 101.6.15.130, 2402:f000:1:400::2
Caching mirrors.tuna.tsinghua.edu.cn => 101.6.15.130 2402:f000:1:400::2
正在连接 mirrors.tuna.tsinghua.edu.cn (mirrors.tuna.tsinghua.edu.cn)|101.6.15.130|:443... 已连接。
Created socket 3.
Releasing 0x00005576f88d00a0 (new refcount 1).

---request begin---
GET /centos/8.5.2111/isos/x86_64/CentOS-8.5.2111-x86_64-dvd1.iso HTTP/1.1
User-Agent: Wget/1.21
Accept: */*
Accept-Encoding: identity
Host: mirrors.tuna.tsinghua.edu.cn
Connection: Keep-Alive

---request end---
已发出 HTTP 请求,正在等待回应... 
---response begin---
HTTP/1.1 403 Forbidden
Server: nginx/1.18.0
Date: Sun, 19 Dec 2021 08:34:54 GMT
Content-Type: text/html
Transfer-Encoding: chunked
Connection: keep-alive
Strict-Transport-Security: max-age=31536000
X-TUNA-MIRROR-ID: nanomirrors

---response end---
403 Forbidden
Registered socket 3 for persistent reuse.
Parsed Strict-Transport-Security max-age = 31536000, includeSubDomains = false
Updated HSTS host: mirrors.tuna.tsinghua.edu.cn:443 (max-age: 31536000, includeSubdomains: false)
Skipping 512 bytes of body: [<!DOCTYPE html>
<html>
  <head>
    <meta charset="utf-8">
    <meta http-equiv="X-UA-Compatible" content="IE=edge">
    <meta name="viewport" content="width=device-width, initial-scale=1">
    <title>清华大学 TUNA 镜像站</title>
    <link href="//cdn.jsdelivr.Skipping 512 bytes of body: [net/npm/bootstrap@3.3.7/dist/css/bootstrap.min.css" rel="stylesheet">
    <style> body { padding-top: 40px; } </style>
  </head>
  <body>
    <div class="container">
      <div class="well">
        <p lang="zh-cn">尊敬的访问者,</p>
		<p lang="en">Dear visitor, </p>
		<p lang="fr">Chère cliente, </p>
		<p lang="ja">訪問者へ 、</p>
		<p>&nbsp;</p>
        <p lang="zh-cn">您好!</p>
		<p lang="en">Hello! </p>
		<p lang="fr">Bonjour! </p>
		<p lang="ja">こんにちは !</p>
		<p>&nbsp;</p>
Skipping 512 bytes of body: [        <p lang="zh-cn">我们检测到您正在使用移动设备下载镜像站上较大的二进制文件,为防止消耗过多流量,我们建议您改用计算机下载。</p>
		<p lang="en">Your attempt to download a large binary file from a mobile device has been detected. To avoid excessive consumption of data transfer, you are recommended to download it from a computer. </p>
		<p lang="fr">Une tentative de téléchargement d'un fichier binaire de grande taille depuis un appareil mobile a été Skipping 512 bytes of body: [détectée. Afin d'éviter une consommation excessive de données mobile, nous vous conseillons de recommencer cette action à partir d'un ordinateur. </p>
		<p lang="ja">容量の大きいバイナリファイルが今モバイルデバイスに転送しようとしております、大量のトラフィックが発生するため、コンピュータからのダウンロードをお勧めします。</p>
		<p>&nbsp;</p>
		<p lang="zh-cn">如有疑问,请联系 <a href="mailto:support@tuna.tsinghua.edu.cSkipping 512 bytes of body: [n">support@tuna.tsinghua.edu.cn</a> 。</p>
		<p lang="en">If there are any possible questions, please contact <a href="mailto:support@tuna.tsinghua.edu.cn">support@tuna.tsinghua.edu.cn</a>. </p>
		<p lang="fr">Pour plus d'informations, veuillez contacter <a href="mailto:support@tuna.tsinghua.edu.cn">support@tuna.tsinghua.edu.cn</a>. </p>
		<p lang="ja">なおご質問などありましたら、<a href="mailto:support@tuna.tsinghua.edu.cn">support@tuna.tsinghua.edu.cn</a>までご連絡してください。Skipping 127 bytes of body: [</p>
		<p>&nbsp;</p>
		<p><code>00000070 e0c0e5fba7856c37ba7f0d56b6850407</code></p>
      </div>
    </div>
  </body>
</html>
] done.
2021-12-19 16:34:54 错误 403:Forbidden。

Saving HSTS entries to /home/zby/.wget-hsts

期望的现象(What you expected to happen)

Wget可以正常下载

如何重现此问题(How to reproduce it)

wget -d 'https://mirrors.tuna.tsinghua.edu.cn/centos/8.5.2111/isos/x86_64/CentOS-8.5.2111-x86_64-dvd1.iso'

操作系统(OS Version)

Debian 11

浏览器(如果适用)(Browser version, if applicable)

Wget 1.21

其他环境(Other environments)

No response

其他需要说明的事项(Anything else we need to know)

No response

closed time in a month

zhangboyang

issue commenttuna/issues

Wget下载CentOS ISO显示403 Forbidden

您好,请不要使用 wget 下载 centos 的 iso 文件,作为代替,您可以选择使用 curl。

zhangboyang

comment created time in a month

issue commenttuna/tunasync

unexpected end of filter rule: risk

/opt/mirrors/tunasync/log/tunasync/qt 下的 log 请提供一下。

canghaiwuhen

comment created time in a month

issue commenttuna/tunasync

unexpected end of filter rule: risk

请提供完整的配置文件,和 tunasync worker 的标准错误输出,以及相应 mirror 任务的日志。

canghaiwuhen

comment created time in a month

issue closedtuna/issues

Specific files are 404 on BFSU (but normal on original TUNA server)

先决条件 (Prerequisites)

  • [X] 我已确认这个问题没有在其他 issues中提出过。 I am sure that this problem has NEVER been discussed in other issues.

发生了什么(What happened)

https://mirrors.bfsu.edu.cn/pypi/web/packages/40/e0/ad1edd74311831ca71b32a5b83352b490d78d11a90a1cde04e1b6830e018/aiosqlite-0.17.0.tar.gz is 404, but https://mirrors.tuna.edu.cn/pypi/web/packages/40/e0/ad1edd74311831ca71b32a5b83352b490d78d11a90a1cde04e1b6830e018/aiosqlite-0.17.0.tar.gz is okay

期望的现象(What you expected to happen)

This file should be downloadable.

如何重现此问题(How to reproduce it)

wget https://mirrors.bfsu.edu.cn/pypi/web/packages/40/e0/ad1edd74311831ca71b32a5b83352b490d78d11a90a1cde04e1b6830e018/aiosqlite-0.17.0.tar.gz

操作系统(OS Version)

No response

浏览器(如果适用)(Browser version, if applicable)

No response

其他环境(Other environments)

No response

其他需要说明的事项(Anything else we need to know)

Checking previous issues shows that multiple files in pypi/ are reported, see #1378 #1374 etc.

closed time in a month

Icenowy

issue commenttuna/issues

Specific files are 404 on BFSU (but normal on original TUNA server)

已经修理了。

Icenowy

comment created time in a month

more