libnetlink: fix netlink buffer space handling