- dev - passt

[PATCH 0/3] tests: A few fixes for demos
by Stefano Brivio 19 May '22

19 May '22

This series fixes issues that came with the previous test clean-up series, or that were made visible by it. Stefano Brivio (3): demo/pasta: Fix bad sleep directive tests: Don't count number of test units for demos tests: Don't check exit code for every command in demo mode test/demo/pasta | 2 +- test/lib/term | 3 +++ test/lib/test | 6 ++++-- 3 files changed, 8 insertions(+), 3 deletions(-) -- 2.35.1

2 6

[PATCH 00/12] Tests fixes and clean-ups
by Stefano Brivio 18 May '22

18 May '22

This series, mostly from David, cleans up a number of atrocities in the test suite, makes it more observable by reporting test failures whenever a command fails, and a bit more robust by improving filtering in pane_parse(). Further, the whole script now fails if an unhandled failure occurs. A few assorted fixes are included as well. David Gibson (9): tests: Remove unused XVFB variable tests: Add some debugging output for the test scripts themselves tests: Don't use tmux update-environment tests: Don't globally set tmux default-shell tests: Improve control character filtering in pane_parse tests: Don't ignore errors during script tests: Add pane_status command to check for success of issued commands tests: Simplify *tools commands using pane_status tests: Simplify explicit checks for command success Stefano Brivio (3): tests: Update mbuto git URLs test/perf/pasta_udp: Drop redundant assignment of ::1 to loopback interface test/run: Return 0 from run(), exit value already reflects failures test/build/static_checkers | 6 ++-- test/demo/passt | 2 +- test/distro/debian | 33 +++++++------------ test/distro/opensuse | 18 ++++------- test/distro/ubuntu | 15 +++------ test/icmp/passt_in_ns | 4 --- test/lib/setup | 59 ++++++++++++++++------------------ test/lib/term | 30 ++++++++++++++---- test/lib/test | 65 ++++++++++++++++++-------------------- test/perf/pasta_udp | 1 - test/run | 7 ++-- 11 files changed, 108 insertions(+), 132 deletions(-) -- 2.35.1

2 14

[PATCH 00/16] Fix issues reported by Coverity
by Stefano Brivio 05 Apr '22

05 Apr '22

Most of these are formal issues with no actual effect, some are false positives, but it looks sensible to fix all of them and there's also an interesting finding in udp_timer(). Stefano Brivio (16): treewide: Invalid type in argument to printf format specifier, CWE-686 passt: Ignoring number of bytes read, CWE-252 tcp: False "Untrusted loop bound" positive, CWE-606 treewide: Unchecked return value from library, CWE-252 tap: Resource leak, CWE-404 conf, packet: Operands don't affect result, CWE-569 passt: Improper use of negative value (CWE-394) treewide: Argument cannot be negative, CWE-687 conf: False "Assign instead of compare" positive, CWE-481 conf, tap: False "Buffer not null terminated" positives, CWE-170 tcp: Dereference null return value, CWE-476 tcp_splice: Logically dead code, CWE-561 tcp, tcp_splice: False "Negative array index read" positives, CWE-129 tcp: False "Out-of-bounds read" positive, CWE-125 udp: Out-of-bounds read, CWE-125 in udp_timer() arch: Pointer to local outside scope, CWE-562 arch.c | 10 +++--- conf.c | 15 +++++---- icmp.c | 13 +++++--- netlink.c | 40 ++++++++++++++--------- packet.c | 8 ++--- passt.c | 24 ++++++++++---- pasta.c | 25 +++++---------- pcap.c | 6 ++-- qrap.c | 15 ++++++--- tap.c | 35 +++++++++++++------- tcp.c | 75 ++++++++++++++++++++++++++----------------- tcp_splice.c | 91 ++++++++++++++++++++++++++++++++++------------------ udp.c | 5 +-- util.c | 11 ++++--- util.h | 9 ++++++ 15 files changed, 238 insertions(+), 144 deletions(-) -- 2.35.1

1 16

[PATCH 00/24] Boundary-checked "packets", TCP timerfd timeouts, assorted fixes
by Stefano Brivio 25 Mar '22

25 Mar '22

Stefano Brivio (24): conf, util, tap: Implement --trace option for extra verbose logging pcap: Fix mistake in printed string util: Drop CHECK_SET_MIN_MAX{,_PROTO_FD} macros util: Use standard int types tcp: Refactor to use events instead of states, split out spliced implementation test/lib/video: Fill in href attributes of video shortcuts udp: Drop _splice from recv, send, sendto static buffer names udp: Split buffer queueing/writing parts of udp_sock_handler() dhcpv6, tap, tcp: Use IN6_ARE_ADDR_EQUAL instead of open-coded memcmp() udp: Use flags for local, loopback, and configured unicast binds Makefile: Enable a few hardening flags test: Add asciinema(1) as requirement for CI in README test, seccomp, Makefile: Switch to valgrind runs for passt functional tests tcp, udp, util: Enforce 24-bit limit on socket numbers tcp: Rework timers to use timerfd instead of periodic bitmap scan tcp_splice: Close sockets right away on high number of open files test/perf: Work-around for virtio_net hang before long streams from guest README: Avoid "here" links README: Update Interfaces and Availability sections tcp: Fit struct tcp_conn into a single 64-byte cacheline dhcp: Minimum option length implied by RFC 951 is 60 bytes, not 62 tcp, tcp_splice: Use less awkward syntax to swap in/out sockets from pools util: Fix function declaration style of write_pidfile() treewide: Packet abstraction with mandatory boundary checks Makefile | 18 +- README.md | 58 +- arp.c | 51 +- arp.h | 2 +- conf.c | 15 + dhcp.c | 62 +- dhcp.h | 2 +- dhcpv6.c | 151 +- dhcpv6.h | 3 +- icmp.c | 28 +- icmp.h | 4 +- ndp.c | 59 +- ndp.h | 3 +- packet.c | 134 ++ packet.h | 77 + passt.1 | 5 + passt.c | 13 +- passt.h | 9 +- pcap.c | 2 +- seccomp.sh | 1 + tap.c | 331 ++-- tcp.c | 3023 +++++++++++++++---------------------- tcp.h | 27 +- tcp_splice.c | 888 +++++++++++ tcp_splice.h | 15 + test/README.md | 10 +- test/lib/setup | 52 +- test/lib/video | 2 +- test/perf/passt_tcp | 15 + test/perf/passt_udp | 15 + test/run | 9 + test/valgrind.supp | 9 + test/valgrind/passt | 22 + test/valgrind/passt_in_ns | 22 + udp.c | 501 +++--- udp.h | 6 +- util.c | 95 +- util.h | 43 +- 38 files changed, 3313 insertions(+), 2469 deletions(-) create mode 100644 packet.c create mode 100644 packet.h create mode 100644 tcp_splice.c create mode 100644 tcp_splice.h create mode 100644 test/valgrind.supp create mode 100644 test/valgrind/passt create mode 100644 test/valgrind/passt_in_ns -- 2.35.1

1 24

[PATCH] test/lib/setup: Unshare PID namespace in pasta_setup()
by Stefano Brivio 02 Mar '22

02 Mar '22

...otherwise, we'll leave processes (dhclient) around. Signed-off-by: Stefano Brivio <sbrivio(a)redhat.com> --- test/lib/setup | 12 ++++++++---- 1 file changed, 8 insertions(+), 4 deletions(-) diff --git a/test/lib/setup b/test/lib/setup index b076eff..f04949e 100755 --- a/test/lib/setup +++ b/test/lib/setup @@ -69,12 +69,16 @@ setup_pasta() { layout_pasta - pane_run NS "unshare -rUn /bin/sh " + pane_run NS 'echo $$' pane_wait NS + __tty_pid="$(pane_parse NS)" - pane_run NS 'echo $$' + pane_run NS "unshare -rUnpf /bin/sh" pane_wait NS - __pasta_pid="$(pane_parse NS)" + + pane_run PASST "pstree -p ${__tty_pid} | sed -n 's/.*($[0-9].*$)$/\1/p'" + pane_wait PASST + __target_pid="$(pane_parse PASST)" # Ports: # @@ -87,7 +91,7 @@ setup_pasta() { [ ${PCAP} -eq 1 ] && __opts="${__opts} -p /tmp/pasta.pcap" [ ${DEBUG} -eq 1 ] && __opts="${__opts} -d" - pane_run PASST "./pasta ${__opts} -f -t 10002 -T 10003 -u 10002 -U 10003 ${__pasta_pid}" + pane_run PASST "./pasta ${__opts} -f -t 10002 -T 10003 -u 10002 -U 10003 ${__target_pid}" sleep 1 } -- 2.34.1

1 0

[PATCH] arp, dhcp: Fix strict aliasing warnings reported by gcc 4.9 with -Ofast
by Stefano Brivio 28 Feb '22

28 Feb '22

Signed-off-by: Stefano Brivio <sbrivio(a)redhat.com> --- arp.c | 3 ++- dhcp.c | 14 +++++++------- 2 files changed, 9 insertions(+), 8 deletions(-) diff --git a/arp.c b/arp.c index b5af49f..3195692 100644 --- a/arp.c +++ b/arp.c @@ -58,7 +58,8 @@ int arp(struct ctx *c, struct ethhdr *eh, size_t len) /* Discard announcements (but not 0.0.0.0 "probes"): we might have the * same IP address, hide that. */ - if (*((uint32_t *)&am->sip) && !memcmp(am->sip, am->tip, 4)) + if (memcmp(am->sip, (unsigned char[4]){ 0, 0, 0, 0 }, 4) && + !memcmp(am->sip, am->tip, 4)) return 1; /* Don't resolve our own address, either. */ diff --git a/dhcp.c b/dhcp.c index ab1249c..197a515 100644 --- a/dhcp.c +++ b/dhcp.c @@ -40,9 +40,9 @@ struct opt { int sent; int slen; - unsigned char s[255]; + uint8_t s[255]; int clen; - unsigned char c[255]; + uint8_t c[255]; }; static struct opt opts[255]; @@ -312,9 +312,9 @@ int dhcp(struct ctx *c, struct ethhdr *eh, size_t len) m->chaddr[3], m->chaddr[4], m->chaddr[5]); m->yiaddr = c->addr4; - *(unsigned long *)opts[1].s = c->mask4; - *(unsigned long *)opts[3].s = c->gw4; - *(unsigned long *)opts[54].s = c->gw4; + memcpy(opts[1].s, &c->mask4, sizeof(c->mask4)); + memcpy(opts[3].s, &c->gw4, sizeof(c->gw4)); + memcpy(opts[54].s, &c->gw4, sizeof(c->gw4)); /* If the gateway is not on the assigned subnet, send an option 121 * (Classless Static Routing) adding a dummy route to it. @@ -323,8 +323,8 @@ int dhcp(struct ctx *c, struct ethhdr *eh, size_t len) /* a.b.c.d/32:0.0.0.0, 0:a.b.c.d */ opts[121].slen = 14; opts[121].s[0] = 32; - *(unsigned long *)&opts[121].s[1] = c->gw4; - *(unsigned long *)&opts[121].s[10] = c->gw4; + memcpy(opts[121].s + 1, &c->gw4, sizeof(c->gw4)); + memcpy(opts[121].s + 10, &c->gw4, sizeof(c->gw4)); } if (c->mtu != -1) { -- 2.34.1

1 0

[PATCH v2] passt, pasta: Run-time selection of AVX2 build
by Stefano Brivio 28 Feb '22

28 Feb '22

Build-time selection of AVX2 flags and routines is not practical for distributions, but limiting AVX2 usage to checksum routines with specific run-time detection doesn't allow for easy performance gains from auto-vectorisation of batched packet handling routines. For x86_64, build non-AVX2 and AVX2 binaries, and implement a simple wrapper replacing the current executable with the AVX2 build if it's available, and if AVX2 is supported by the current CPU. Signed-off-by: Stefano Brivio <sbrivio(a)redhat.com> --- v2: Add arch.c and arch.h to commit Makefile | 38 ++++++++++++++++++++++++++++---------- README.md | 28 +++++++++++----------------- arch.c | 42 ++++++++++++++++++++++++++++++++++++++++++ arch.h | 6 ++++++ hooks/pre-push | 9 --------- passt.c | 3 +++ test/build/all | 10 ---------- test/demo/passt | 2 +- test/demo/pasta | 2 +- 9 files changed, 92 insertions(+), 48 deletions(-) create mode 100644 arch.c create mode 100644 arch.h diff --git a/Makefile b/Makefile index 031b684..8387719 100644 --- a/Makefile +++ b/Makefile @@ -14,8 +14,11 @@ ifeq ($(RLIMIT_STACK_VAL),unlimited) RLIMIT_STACK_VAL := 1024 endif -AUDIT_ARCH := $(shell uname -m | tr [a-z] [A-Z]) -AUDIT_ARCH := $(shell echo $(AUDIT_ARCH) | sed 's/^ARM.*/ARM/') +# Get 'uname -m'-like architecture description for target +TARGET_ARCH := $(shell $(CC) -dumpmachine | cut -f1 -d- | tr [a-z] [A-Z]) +TARGET_ARCH := $(shell echo $(TARGET_ARCH) | sed 's/POWERPC/PPC/') + +AUDIT_ARCH := $(shell echo $(TARGET_ARCH) | sed 's/^ARM.*/ARM/') AUDIT_ARCH := $(shell echo $(AUDIT_ARCH) | sed 's/I[456]86/I386/') AUDIT_ARCH := $(shell echo $(AUDIT_ARCH) | sed 's/PPC64/PPC/') AUDIT_ARCH := $(shell echo $(AUDIT_ARCH) | sed 's/PPCLE/PPC64LE/') @@ -25,7 +28,7 @@ CFLAGS += -DPAGE_SIZE=$(shell getconf PAGE_SIZE) CFLAGS += -DNETNS_RUN_DIR=\"/run/netns\" CFLAGS += -DPASST_AUDIT_ARCH=AUDIT_ARCH_$(AUDIT_ARCH) CFLAGS += -DRLIMIT_STACK_VAL=$(RLIMIT_STACK_VAL) -CFLAGS += -DARCH=\"$(shell uname -m)\" +CFLAGS += -DARCH=\"$(TARGET_ARCH)\" # On gcc 11.2, with -O2 and -flto, tcp_hash() and siphash_20b(), if inlined, # seem to be hitting something similar to: @@ -63,10 +66,13 @@ endif prefix ?= /usr/local +ifeq ($(TARGET_ARCH),X86_64) +all: passt passt.avx2 pasta pasta.avx2 qrap +BIN := passt passt.avx2 pasta pasta.avx2 qrap +else all: passt pasta qrap - -avx2: CFLAGS += -Ofast -mavx2 -ftree-vectorize -funroll-loops -avx2: clean all +BIN := passt pasta qrap +endif static: CFLAGS += -static -DGLIBC_NO_STATIC_NSS static: clean all @@ -78,6 +84,16 @@ passt: $(filter-out qrap.c,$(wildcard *.c)) \ $(filter-out qrap.h,$(wildcard *.h)) seccomp.h $(CC) $(CFLAGS) $(filter-out qrap.c,$(wildcard *.c)) -o passt +passt.avx2: CFLAGS += -Ofast -mavx2 -ftree-vectorize -funroll-loops +passt.avx2: $(filter-out qrap.c,$(wildcard *.c)) \ + $(filter-out qrap.h,$(wildcard *.h)) seccomp.h + $(CC) $(CFLAGS) $(filter-out qrap.c,$(wildcard *.c)) -o passt.avx2 + +passt.avx2: passt + +pasta.avx2: passt.avx2 + ln -s passt.avx2 pasta.avx2 + pasta: passt ln -s passt pasta ln -s passt.1 pasta.1 @@ -88,24 +104,26 @@ qrap: qrap.c passt.h .PHONY: clean clean: - -${RM} passt *.o seccomp.h qrap pasta pasta.1 \ + -${RM} passt passt.avx2 *.o seccomp.h qrap pasta pasta.avx2 pasta.1 \ passt.tar passt.tar.gz *.deb *.rpm -install: passt pasta qrap +install: $(BIN) mkdir -p $(DESTDIR)$(prefix)/bin $(DESTDIR)$(prefix)/share/man/man1 - cp -d passt pasta qrap $(DESTDIR)$(prefix)/bin + cp -d $(BIN) $(DESTDIR)$(prefix)/bin cp -d passt.1 pasta.1 qrap.1 $(DESTDIR)$(prefix)/share/man/man1 uninstall: -${RM} $(DESTDIR)$(prefix)/bin/passt + -${RM} $(DESTDIR)$(prefix)/bin/passt.avx2 -${RM} $(DESTDIR)$(prefix)/bin/pasta + -${RM} $(DESTDIR)$(prefix)/bin/pasta.avx2 -${RM} $(DESTDIR)$(prefix)/bin/qrap -${RM} $(DESTDIR)$(prefix)/share/man/man1/passt.1 -${RM} $(DESTDIR)$(prefix)/share/man/man1/pasta.1 -${RM} $(DESTDIR)$(prefix)/share/man/man1/qrap.1 pkgs: - tar cf passt.tar -P --xform 's//\/usr\/bin\//' passt pasta qrap + tar cf passt.tar -P --xform 's//\/usr\/bin\//' $(BIN) tar rf passt.tar -P --xform 's//\/usr\/share\/man\/man1\//' \ passt.1 pasta.1 qrap.1 gzip passt.tar diff --git a/README.md b/README.md index 14e1777..4966e15 100644 --- a/README.md +++ b/README.md @@ -220,7 +220,7 @@ speeding up local connections, and usually requiring NAT. _pasta_: * Linux * ✅ starting from 4.18 kernel version * ✅ starting from 3.13 kernel version -* 🛠 build-time selection of AVX2 instructions (as much as possible) +* ✅ run-time selection of AVX2 build * ⌚ [_musl_](https://bugs.passt.top/show_bug.cgi?id=4) and [_uClibc-ng_](https://bugs.passt.top/show_bug.cgi?id=5) * ⌚ [FreeBSD](https://bugs.passt.top/show_bug.cgi?id=6), @@ -467,15 +467,12 @@ Test logs [here](/builds/latest/test/). cd passt make - * alternatively, static builds for x86_64, with or without AVX2 instructions, - as of the latest commit are also available for convenience - [here](/builds/latest/x86_64/avx2/) and - [here](/builds/latest/x86_64/). Convenience, non-official - packages for Debian (and derivatives) and RPM-based distributions are also - available there. These binaries and packages are simply built with: + * alternatively, static builds for x86_64 as of the latest commit are also + available for convenience [here](/builds/latest/x86_64/). Convenience, + non-official packages for Debian (and derivatives) and RPM-based + distributions are also available there. These binaries and packages are + simply built with: - CFLAGS="-static" make avx2 - make pkgs make static make pkgs @@ -530,15 +527,12 @@ Test logs [here](/builds/latest/test/). cd passt make - * alternatively, static builds for x86_64, with or without AVX2 instructions, - as of the latest commit are also available for convenience - [here](/builds/latest/x86_64/avx2/) and - [here](/builds/latest/x86_64/). Convenience, non-official - packages for Debian (and derivatives) and RPM-based distributions are also - available there. These binaries and packages are simply built with: + * alternatively, static builds for x86_64 as of the latest commit are also + available for convenience [here](/builds/latest/x86_64/). Convenience, + non-official packages for Debian (and derivatives) and RPM-based + distributions are also available there. These binaries and packages are + simply built with: - CFLAGS="-static" make avx2 - make pkgs make static make pkgs diff --git a/arch.c b/arch.c new file mode 100644 index 0000000..b8e1db5 --- /dev/null +++ b/arch.c @@ -0,0 +1,42 @@ +// SPDX-License-Identifier: AGPL-3.0-or-later + +/* PASST - Plug A Simple Socket Transport + * for qemu/UNIX domain socket mode + * + * PASTA - Pack A Subtle Tap Abstraction + * for network namespace/tap device mode + * + * arch.c - Architecture-specific implementations + * + * Copyright (c) 2022 Red Hat GmbH + * Author: Stefano Brivio <sbrivio(a)redhat.com> + */ + +#include <limits.h> +#include <stdio.h> +#include <string.h> +#include <unistd.h> + +/** + * arch_avx2_exec() - Run AVX2 build if supported, drop suffix from argv[0] + * @argv: Arguments from command line + */ +#ifdef __x86_64__ +void arch_avx2_exec(char **argv) +{ + char *p = strstr(argv[0], ".avx2"); + + if (p) { + *p = 0; + } else if (__builtin_cpu_supports("avx2")) { + char path[PATH_MAX]; + + snprintf(path, PATH_MAX, "%s.avx2", argv[0]); + argv[0] = path; + execve(path, argv, environ); + perror("Can't run AVX2 build, using non-AVX2 version"); + } +} +#else +void arch_avx2_exec(char **argv) { (void)argv; } +#endif diff --git a/arch.h b/arch.h new file mode 100644 index 0000000..ce1c01b --- /dev/null +++ b/arch.h @@ -0,0 +1,6 @@ +/* SPDX-License-Identifier: AGPL-3.0-or-later + * Copyright (c) 2022 Red Hat GmbH + * Author: Stefano Brivio <sbrivio(a)redhat.com> + */ + +void arch_avx2_exec(char **argv); diff --git a/hooks/pre-push b/hooks/pre-push index a3f67f4..6a9b712 100755 --- a/hooks/pre-push +++ b/hooks/pre-push @@ -58,15 +58,6 @@ ssh "${USER_HOST}" "rm -f ${BIN}/*.deb" ssh "${USER_HOST}" "rm -f ${BIN}/*.rpm" scp *.deb *.rpm "${USER_HOST}:${BIN}/" -CFLAGS="-static -DGLIBC_NO_STATIC_NSS" make avx2 -ssh "${USER_HOST}" "mkdir -p ${BIN}/avx2" -scp passt pasta qrap passt.1 pasta.1 qrap.1 "${USER_HOST}:${BIN}/avx2/" - -make pkgs -ssh "${USER_HOST}" "rm -f ${BIN}/avx2/*.deb" -ssh "${USER_HOST}" "rm -f ${BIN}/avx2/*.rpm" -scp *.deb *.rpm "${USER_HOST}:${BIN}/avx2/" - ssh "${USER_HOST}" "mv ${LATEST} ${AWAY}" ssh "${USER_HOST}" "mv ${TEMP} ${LATEST}" ssh "${USER_HOST}" "rm -rf ${AWAY}" diff --git a/passt.c b/passt.c index e7dd108..40d3e57 100644 --- a/passt.c +++ b/passt.c @@ -69,6 +69,7 @@ #include "tap.h" #include "conf.h" #include "pasta.h" +#include "arch.h" #define EPOLL_EVENTS 8 @@ -313,6 +314,8 @@ int main(int argc, char **argv) struct sigaction sa; char *log_name; + arch_avx2_exec(argv); + check_root(); drop_caps(); diff --git a/test/build/all b/test/build/all index 9aa6c61..6043793 100644 --- a/test/build/all +++ b/test/build/all @@ -40,13 +40,3 @@ host CFLAGS="-Werror" make check [ -f passt ] check [ -h pasta ] check [ -f qrap ] - -test Build AVX2 -host make clean -check ! [ -e passt ] -check ! [ -e pasta ] -check ! [ -e qrap ] -host CFLAGS="-Werror" make avx2 -check [ -f passt ] -check [ -h pasta ] -check [ -f qrap ] diff --git a/test/demo/passt b/test/demo/passt index 76aac86..8838363 100644 --- a/test/demo/passt +++ b/test/demo/passt @@ -29,7 +29,7 @@ sleep 1 say and build it. sleep 1 host cd passt -host make avx2 +host make sleep 1 nl diff --git a/test/demo/pasta b/test/demo/pasta index b2dd327..74fca85 100644 --- a/test/demo/pasta +++ b/test/demo/pasta @@ -169,7 +169,7 @@ say more in the "Performance" section below. sleep 3 ns exit passt exit -passt CFLAGS="-g" make avx2 +passt CFLAGS="-g" make sleep 2 passtb perf record -g ./pasta sleep 2 -- 2.34.1

1 0

[PATCH] passt, pasta: Run-time selection of AVX2 build
by Stefano Brivio 28 Feb '22

28 Feb '22

Build-time selection of AVX2 flags and routines is not practical for distributions, but limiting AVX2 usage to checksum routines with specific run-time detection doesn't allow for easy performance gains from auto-vectorisation of batched packet handling routines. For x86_64, build non-AVX2 and AVX2 binaries, and implement a simple wrapper replacing the current executable with the AVX2 build if it's available, and if AVX2 is supported by the current CPU. Signed-off-by: Stefano Brivio <sbrivio(a)redhat.com> --- Makefile | 38 ++++++++++++++++++++++++++++---------- README.md | 28 +++++++++++----------------- hooks/pre-push | 9 --------- passt.c | 3 +++ test/build/all | 10 ---------- test/demo/passt | 2 +- test/demo/pasta | 2 +- 7 files changed, 44 insertions(+), 48 deletions(-) diff --git a/Makefile b/Makefile index 031b684..8387719 100644 --- a/Makefile +++ b/Makefile @@ -14,8 +14,11 @@ ifeq ($(RLIMIT_STACK_VAL),unlimited) RLIMIT_STACK_VAL := 1024 endif -AUDIT_ARCH := $(shell uname -m | tr [a-z] [A-Z]) -AUDIT_ARCH := $(shell echo $(AUDIT_ARCH) | sed 's/^ARM.*/ARM/') +# Get 'uname -m'-like architecture description for target +TARGET_ARCH := $(shell $(CC) -dumpmachine | cut -f1 -d- | tr [a-z] [A-Z]) +TARGET_ARCH := $(shell echo $(TARGET_ARCH) | sed 's/POWERPC/PPC/') + +AUDIT_ARCH := $(shell echo $(TARGET_ARCH) | sed 's/^ARM.*/ARM/') AUDIT_ARCH := $(shell echo $(AUDIT_ARCH) | sed 's/I[456]86/I386/') AUDIT_ARCH := $(shell echo $(AUDIT_ARCH) | sed 's/PPC64/PPC/') AUDIT_ARCH := $(shell echo $(AUDIT_ARCH) | sed 's/PPCLE/PPC64LE/') @@ -25,7 +28,7 @@ CFLAGS += -DPAGE_SIZE=$(shell getconf PAGE_SIZE) CFLAGS += -DNETNS_RUN_DIR=\"/run/netns\" CFLAGS += -DPASST_AUDIT_ARCH=AUDIT_ARCH_$(AUDIT_ARCH) CFLAGS += -DRLIMIT_STACK_VAL=$(RLIMIT_STACK_VAL) -CFLAGS += -DARCH=\"$(shell uname -m)\" +CFLAGS += -DARCH=\"$(TARGET_ARCH)\" # On gcc 11.2, with -O2 and -flto, tcp_hash() and siphash_20b(), if inlined, # seem to be hitting something similar to: @@ -63,10 +66,13 @@ endif prefix ?= /usr/local +ifeq ($(TARGET_ARCH),X86_64) +all: passt passt.avx2 pasta pasta.avx2 qrap +BIN := passt passt.avx2 pasta pasta.avx2 qrap +else all: passt pasta qrap - -avx2: CFLAGS += -Ofast -mavx2 -ftree-vectorize -funroll-loops -avx2: clean all +BIN := passt pasta qrap +endif static: CFLAGS += -static -DGLIBC_NO_STATIC_NSS static: clean all @@ -78,6 +84,16 @@ passt: $(filter-out qrap.c,$(wildcard *.c)) \ $(filter-out qrap.h,$(wildcard *.h)) seccomp.h $(CC) $(CFLAGS) $(filter-out qrap.c,$(wildcard *.c)) -o passt +passt.avx2: CFLAGS += -Ofast -mavx2 -ftree-vectorize -funroll-loops +passt.avx2: $(filter-out qrap.c,$(wildcard *.c)) \ + $(filter-out qrap.h,$(wildcard *.h)) seccomp.h + $(CC) $(CFLAGS) $(filter-out qrap.c,$(wildcard *.c)) -o passt.avx2 + +passt.avx2: passt + +pasta.avx2: passt.avx2 + ln -s passt.avx2 pasta.avx2 + pasta: passt ln -s passt pasta ln -s passt.1 pasta.1 @@ -88,24 +104,26 @@ qrap: qrap.c passt.h .PHONY: clean clean: - -${RM} passt *.o seccomp.h qrap pasta pasta.1 \ + -${RM} passt passt.avx2 *.o seccomp.h qrap pasta pasta.avx2 pasta.1 \ passt.tar passt.tar.gz *.deb *.rpm -install: passt pasta qrap +install: $(BIN) mkdir -p $(DESTDIR)$(prefix)/bin $(DESTDIR)$(prefix)/share/man/man1 - cp -d passt pasta qrap $(DESTDIR)$(prefix)/bin + cp -d $(BIN) $(DESTDIR)$(prefix)/bin cp -d passt.1 pasta.1 qrap.1 $(DESTDIR)$(prefix)/share/man/man1 uninstall: -${RM} $(DESTDIR)$(prefix)/bin/passt + -${RM} $(DESTDIR)$(prefix)/bin/passt.avx2 -${RM} $(DESTDIR)$(prefix)/bin/pasta + -${RM} $(DESTDIR)$(prefix)/bin/pasta.avx2 -${RM} $(DESTDIR)$(prefix)/bin/qrap -${RM} $(DESTDIR)$(prefix)/share/man/man1/passt.1 -${RM} $(DESTDIR)$(prefix)/share/man/man1/pasta.1 -${RM} $(DESTDIR)$(prefix)/share/man/man1/qrap.1 pkgs: - tar cf passt.tar -P --xform 's//\/usr\/bin\//' passt pasta qrap + tar cf passt.tar -P --xform 's//\/usr\/bin\//' $(BIN) tar rf passt.tar -P --xform 's//\/usr\/share\/man\/man1\//' \ passt.1 pasta.1 qrap.1 gzip passt.tar diff --git a/README.md b/README.md index 14e1777..4966e15 100644 --- a/README.md +++ b/README.md @@ -220,7 +220,7 @@ speeding up local connections, and usually requiring NAT. _pasta_: * Linux * ✅ starting from 4.18 kernel version * ✅ starting from 3.13 kernel version -* 🛠 build-time selection of AVX2 instructions (as much as possible) +* ✅ run-time selection of AVX2 build * ⌚ [_musl_](https://bugs.passt.top/show_bug.cgi?id=4) and [_uClibc-ng_](https://bugs.passt.top/show_bug.cgi?id=5) * ⌚ [FreeBSD](https://bugs.passt.top/show_bug.cgi?id=6), @@ -467,15 +467,12 @@ Test logs [here](/builds/latest/test/). cd passt make - * alternatively, static builds for x86_64, with or without AVX2 instructions, - as of the latest commit are also available for convenience - [here](/builds/latest/x86_64/avx2/) and - [here](/builds/latest/x86_64/). Convenience, non-official - packages for Debian (and derivatives) and RPM-based distributions are also - available there. These binaries and packages are simply built with: + * alternatively, static builds for x86_64 as of the latest commit are also + available for convenience [here](/builds/latest/x86_64/). Convenience, + non-official packages for Debian (and derivatives) and RPM-based + distributions are also available there. These binaries and packages are + simply built with: - CFLAGS="-static" make avx2 - make pkgs make static make pkgs @@ -530,15 +527,12 @@ Test logs [here](/builds/latest/test/). cd passt make - * alternatively, static builds for x86_64, with or without AVX2 instructions, - as of the latest commit are also available for convenience - [here](/builds/latest/x86_64/avx2/) and - [here](/builds/latest/x86_64/). Convenience, non-official - packages for Debian (and derivatives) and RPM-based distributions are also - available there. These binaries and packages are simply built with: + * alternatively, static builds for x86_64 as of the latest commit are also + available for convenience [here](/builds/latest/x86_64/). Convenience, + non-official packages for Debian (and derivatives) and RPM-based + distributions are also available there. These binaries and packages are + simply built with: - CFLAGS="-static" make avx2 - make pkgs make static make pkgs diff --git a/hooks/pre-push b/hooks/pre-push index a3f67f4..6a9b712 100755 --- a/hooks/pre-push +++ b/hooks/pre-push @@ -58,15 +58,6 @@ ssh "${USER_HOST}" "rm -f ${BIN}/*.deb" ssh "${USER_HOST}" "rm -f ${BIN}/*.rpm" scp *.deb *.rpm "${USER_HOST}:${BIN}/" -CFLAGS="-static -DGLIBC_NO_STATIC_NSS" make avx2 -ssh "${USER_HOST}" "mkdir -p ${BIN}/avx2" -scp passt pasta qrap passt.1 pasta.1 qrap.1 "${USER_HOST}:${BIN}/avx2/" - -make pkgs -ssh "${USER_HOST}" "rm -f ${BIN}/avx2/*.deb" -ssh "${USER_HOST}" "rm -f ${BIN}/avx2/*.rpm" -scp *.deb *.rpm "${USER_HOST}:${BIN}/avx2/" - ssh "${USER_HOST}" "mv ${LATEST} ${AWAY}" ssh "${USER_HOST}" "mv ${TEMP} ${LATEST}" ssh "${USER_HOST}" "rm -rf ${AWAY}" diff --git a/passt.c b/passt.c index e7dd108..40d3e57 100644 --- a/passt.c +++ b/passt.c @@ -69,6 +69,7 @@ #include "tap.h" #include "conf.h" #include "pasta.h" +#include "arch.h" #define EPOLL_EVENTS 8 @@ -313,6 +314,8 @@ int main(int argc, char **argv) struct sigaction sa; char *log_name; + arch_avx2_exec(argv); + check_root(); drop_caps(); diff --git a/test/build/all b/test/build/all index 9aa6c61..6043793 100644 --- a/test/build/all +++ b/test/build/all @@ -40,13 +40,3 @@ host CFLAGS="-Werror" make check [ -f passt ] check [ -h pasta ] check [ -f qrap ] - -test Build AVX2 -host make clean -check ! [ -e passt ] -check ! [ -e pasta ] -check ! [ -e qrap ] -host CFLAGS="-Werror" make avx2 -check [ -f passt ] -check [ -h pasta ] -check [ -f qrap ] diff --git a/test/demo/passt b/test/demo/passt index 76aac86..8838363 100644 --- a/test/demo/passt +++ b/test/demo/passt @@ -29,7 +29,7 @@ sleep 1 say and build it. sleep 1 host cd passt -host make avx2 +host make sleep 1 nl diff --git a/test/demo/pasta b/test/demo/pasta index b2dd327..74fca85 100644 --- a/test/demo/pasta +++ b/test/demo/pasta @@ -169,7 +169,7 @@ say more in the "Performance" section below. sleep 3 ns exit passt exit -passt CFLAGS="-g" make avx2 +passt CFLAGS="-g" make sleep 2 passtb perf record -g ./pasta sleep 2 -- 2.34.1

1 0

[PATCH] test/distro/opensuse: Add Tumbleweed armv7l test
by Stefano Brivio 28 Feb '22

28 Feb '22

Signed-off-by: Stefano Brivio <sbrivio(a)redhat.com> --- test/distro/opensuse | 29 +++++++++++++++++++++++++++++ 1 file changed, 29 insertions(+) diff --git a/test/distro/opensuse b/test/distro/opensuse index 6e29b45..a2c0944 100644 --- a/test/distro/opensuse +++ b/test/distro/opensuse @@ -152,6 +152,35 @@ hint sleep 1 +test OpenSUSE Tumbleweed armv7l + +temp IMG +temp ZIMAGE +temp INITRD +host wget http://download.opensuse.org/ports/armv7hl/tumbleweed/appliances/openSUSE-T… -O - | xz -d > __IMG__ +host guestfish -a __IMG__ -i download /boot/zImage __ZIMAGE__ +host guestfish -a __IMG__ -i download /boot/initrd __INITRD__ +host virt-edit -a __IMG__ -m /dev/sda3 /usr/lib/systemd/system/serial-getty@.service -e 's/ExecStart=.*/ExecStart=\/sbin\/agetty --timeout 5000 --autologin root -i -8 --keep-baud 115200,38400,9600 %I $TERM/g' +host guestfish --rw -a __IMG__ -i copy-in __GUEST_FILES__ /root/ + +host ./qrap 5 qemu-system-arm -M virt -m 1024 -nographic -serial stdio -nodefaults -no-reboot -nographic -vga none -kernel __ZIMAGE__ -initrd __INITRD__ -append 'root=/dev/sda3' -drive if=none,file=__IMG__,format=raw,id=hd,media=disk -device virtio-scsi-device -device scsi-hd,drive=hd -netdev socket,fd=5,id=passt -device virtio-net-device,netdev=passt +host PS1='$ ' +host ip link set eth0 up +sleep 10 +host echo "DNSSERVERS='__DNS6__'" | netconfig modify -s dns_resolver -i eth0 +sleep 10 +host zypper install -y gcc make netcat-openbsd; echo + +host make clean +hout RET CFLAGS="-Werror" make; echo $? +check [ __RET__ -eq 0 ] + +distro_quick_pasta_test + +hint +sleep 1 + + test OpenSUSE Tumbleweed temp IMG -- 2.34.1

1 0

[PATCH] test/lib/term: Don't run demo when started as ./run
by Stefano Brivio 28 Feb '22

28 Feb '22

I changed this in a previous commit by mistake, restore the original command. Signed-off-by: Stefano Brivio <sbrivio(a)redhat.com> --- test/lib/term | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/test/lib/term b/test/lib/term index 205a6a9..c92d8bd 100755 --- a/test/lib/term +++ b/test/lib/term @@ -554,7 +554,7 @@ run_term() { asciinema rec --overwrite demo.uncut -c 'tmux new-session -s passt_test ./run_demo from_term' video_postprocess demo.uncut else - tmux new-session -s passt_test ./run_demo from_term + tmux new-session -s passt_test ./run from_term fi } -- 2.34.1

1 0

2024

2023

2022

2021

dev