justintimperio / warp-cli Goto Github PK

I tried the install script. Thank you so much, it worked on fedora but not in centos 7

here the error:

-- Performing Test FOLLY_HAVE_WEAK_SYMBOLS - Success
CMake Error: The following variables are used in this project, but they are set to NOTFOUND.
Please set them or make sure they are set and tested correctly in the CMake files:
GFLAGS_INCLUDE_DIR
   used as include directory in directory /opt/warp-cli/build/wdt
   used as include directory in directory /opt/warp-cli/build/wdt
   used as include directory in directory /opt/warp-cli/build/wdt
   used as include directory in directory /opt/warp-cli/build/wdt
   used as include directory in directory /opt/warp-cli/build/wdt
   used as include directory in directory /opt/warp-cli/build/wdt
   used as include directory in directory /opt/warp-cli/build/wdt
   used as include directory in directory /opt/warp-cli/build/wdt
   used as include directory in directory /opt/warp-cli/build/wdt
   used as include directory in directory /opt/warp-cli/build/wdt
GFLAGS_LIBRARY
    linked by target "wdt_min" in directory /opt/warp-cli/build/wdt

-- Configuring incomplete, errors occurred!
See also "/opt/warp-cli/build/wdt/_build/CMakeFiles/CMakeOutput.log".
See also "/opt/warp-cli/build/wdt/_build/CMakeFiles/CMakeError.log".
make: *** No targets specified and no makefile found.  Stop.
make: *** No rule to make target `install'.  Stop.

====================================

Warp-CLI Version: 3.0.2
sh: /usr/bin/wdt: No such file or directory
FOLLY Version: v2020.01.06.00

Hi,
I have this error on MacOs 14.2

====================================
          Installing WDT            
====================================

CMake Error at CMakeLists.txt:1:
  Parse error.  Expected a command name, got unquoted argument with text
  "64".

Do you know how I can fix this?

Thanks a lot for all your work

Yo nice tool, but I think auto install isn't quite working yet. This is Ubuntu 18.04.

It seems like /var/app/warp-cli/wdt should point to /var/app/warp-cli/build/wdt (setup.py:45) but something else may be wrong. If i try to manually cmake wdt it says folly is not installed. I inspected your setup.py and I didn't see where it was supposed to make folly.

teque5  /  var  app  python3 /var/app/warp-cli/core/warp.py --install /var/app/warp-cli
Reading package lists... Done
Building dependency tree       
Reading state information... Done
build-essential is already the newest version (12.4ubuntu1).
libboost-system-dev is already the newest version (1.65.1.0ubuntu1).
libdouble-conversion-dev is already the newest version (2.0.1-4ubuntu1).
libboost-all-dev is already the newest version (1.65.1.0ubuntu1).
libgoogle-glog-dev is already the newest version (0.3.5-1).
libgtest-dev is already the newest version (1.8.0-6).
libjemalloc-dev is already the newest version (3.6.0-11).
cmake is already the newest version (3.10.2-1ubuntu2.18.04.1).
libssl-dev is already the newest version (1.1.1-1ubuntu2.1~18.04.4).
openssl is already the newest version (1.1.1-1ubuntu2.1~18.04.4).
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
Cloning into 'folly'...
remote: Enumerating objects: 193, done.
remote: Counting objects: 100% (193/193), done.
remote: Compressing objects: 100% (155/155), done.
remote: Total 64891 (delta 81), reused 85 (delta 38), pack-reused 64698
Receiving objects: 100% (64891/64891), 26.07 MiB | 1.45 MiB/s, done.
Resolving deltas: 100% (52400/52400), done.
Cloning into 'wdt'...
remote: Enumerating objects: 24, done.
remote: Counting objects: 100% (24/24), done.
remote: Compressing objects: 100% (19/19), done.
remote: Total 4695 (delta 7), reused 16 (delta 5), pack-reused 4671
Receiving objects: 100% (4695/4695), 1.77 MiB | 863.00 KiB/s, done.
Resolving deltas: 100% (3758/3758), done.
CMake Error: The source directory "/var/app/warp-cli/wdt" does not exist.
Specify --help for usage, or press the help button on the CMake GUI.
Install Complete!

I've been trying to decide if this is ready for production use, and I have some thoughts.

• All your scripts should have the crunchbang as #!/usr/bin/env python3 since pointing to just /usr/bin/python will resolve weirdly on different machines, and warp-cli isn't python2 compatible
• If something is wrong with the warp-cli install on a remote machine, a transfer doesn't fail, it will simply hang forever. Perhaps there should be a 'test' that verifies that things are installed correctly.
• If a file permission is incorrect for one file in a directory, warp will hang the whole transfer. Meanwhile rsync will skip that file then say some files/attrs were not transferred. scp will say Permission denied for that one file.
• I can't do warp --version. Perhaps put a __version__ = '2.0.0' somewhere in your script, then you can reference it. It would be best if it printed warp-cli, wdt, and folly version.
• wdt is SO verbose. It would be nicer if it were quieter.
• I think trying to automate the install is too painful. You can tell folks to get the exact versions of folly and wdt and install the libraries, people can follow those instructions. Automating apt is wierd since your approach doesn't work behind corporate proxies and I think there are a lot of edge cases.

If I was doing this I would layout warp-cli as a python package like this and in the setup.py you would add an entry_point:

setup(
    # other stuff
    entry_points={
        'console_scripts': [
            'warp = warp:main',
        ],
    }
)

Then you could simply do a pip install warp-cli and exit early from the installation if the libraries you needed weren't found. Otherwise it would install warp normally in the user's ~/.local/bin or wherever.

If you'd like I can create a PR that starts going in this direction, but I didn't want to attempt if you weren't interested.

Hi! Can I use your warp-cli wrapper and WDT to pull data onto a client behind a NAT from a publicly accessible server?

installing on wsl2 (ubuntu 22.04) i get this error, any clues?
[ 24%] Building CXX object CMakeFiles/wdt_min.dir/util/WdtSocket.cpp.o
[ 26%] Building CXX object CMakeFiles/wdt_min.dir/ErrorCodes.cpp.o
[ 28%] Building CXX object CMakeFiles/wdt_min.dir/util/DirectorySourceQueue.cpp.o
[ 33%] Building CXX object CMakeFiles/wdt_min.dir/util/EncryptionUtils.cpp.o
[ 33%] Building CXX object CMakeFiles/wdt_min.dir/util/ClientSocket.cpp.o
[ 35%] Building CXX object CMakeFiles/wdt_min.dir/util/FileByteSource.cpp.o
[ 37%] Building CXX object CMakeFiles/wdt_min.dir/Protocol.cpp.o
[ 40%] Building CXX object CMakeFiles/wdt_min.dir/util/FileCreator.cpp.o
[ 42%] Building CXX object CMakeFiles/wdt_min.dir/WdtThread.cpp.o
[ 46%] Building CXX object CMakeFiles/wdt_min.dir/util/ThreadsController.cpp.o
[ 46%] Building CXX object CMakeFiles/wdt_min.dir/ReceiverThread.cpp.o
[ 48%] Building CXX object CMakeFiles/wdt_min.dir/Receiver.cpp.o
[ 51%] Building CXX object CMakeFiles/wdt_min.dir/WdtTransferRequest.cpp.o
[ 53%] Building CXX object CMakeFiles/wdt_min.dir/util/ThreadTransferHistory.cpp.o
[ 55%] Building CXX object CMakeFiles/wdt_min.dir/SenderThread.cpp.o
[ 57%] Building CXX object CMakeFiles/wdt_min.dir/util/ServerSocket.cpp.o
[ 60%] Building CXX object CMakeFiles/wdt_min.dir/Sender.cpp.o
[ 64%] Building CXX object CMakeFiles/wdt_min.dir/Reporting.cpp.o
[ 64%] Building CXX object CMakeFiles/wdt_min.dir/Throttler.cpp.o
[ 66%] Building CXX object CMakeFiles/wdt_min.dir/WdtOptions.cpp.o
[ 68%] Building CXX object CMakeFiles/wdt_min.dir/util/FileWriter.cpp.o
[ 71%] Building CXX object CMakeFiles/wdt_min.dir/util/TransferLogManager.cpp.o
[ 73%] Building CXX object CMakeFiles/wdt_min.dir/util/Stats.cpp.o
[ 75%] Building CXX object CMakeFiles/wdt_min.dir/util/SerializationUtil.cpp.o
In file included from /opt/warp-cli/build/wdt/Sender.cpp:9:
/opt/warp-cli/build/wdt/../wdt/Sender.h:15:10: fatal error: gtest/gtest_prod.h: No such file or directory
15 | #include <gtest/gtest_prod.h>
| ^~~~~~~~~~~~~~~~~~~~
compilation terminated.
In file included from /opt/warp-cli/build/wdt/../wdt/SenderThread.h:11,
from /opt/warp-cli/build/wdt/SenderThread.cpp:9:
/opt/warp-cli/build/wdt/../wdt/Sender.h:15:10: fatal error: gtest/gtest_prod.h: No such file or directory
15 | #include <gtest/gtest_prod.h>
| ^~~~~~~~~~~~~~~~~~~~
compilation terminated.

how to solve Failed getaddrinfo xiangxiaoyudeMacBook-Pro.local , 58472 : -2 : Name or service not known

Hi,

So the first two commands were successful but running the install script shows the following error.
Any idea what could be wrong?

[user@localhost ~]$ python3 /usr/app/warp-cli/core/warp.py --install
Warp-CLI is Now Setup and Registered in /usr/bin!
Do You Want to Attempt an Automatic WDT Build and Install? (y/n):y
Traceback (most recent call last):
File "/usr/app/warp-cli/core/warp.py", line 148, in
setup_warp(base_dir)
File "/usr/app/warp-cli/core/setup.py", line 55, in setup_warp
build_wdt(base_dir)
File "/usr/app/warp-cli/core/setup.py", line 29, in build_wdt
sys.exit('Automated Package Installs for ' + os_name + ' Are NOT Supported.')
NameError: name 'sys' is not defined

Thank you

Can you add the following to the install.sh to enable automated install for Rocky 8?
## Rocky
elif [[ $osname == 'rocky' ]]; then
# Install Dependencies
yum -y install epel-release && \
yum -y --enablerepo=powertools install git python38 cmake boost-devel openssl jemalloc glog-devel double-conversion-devel make automake gcc gcc-c++ kernel-devel gtest-devel openssl-devel libeven t-devel