Comments (3)
This infinite loop prevents yas3fs from stopping cleanly as well. Here is another one
2014-09-25 12:55:56,582 INFO entries, mem_size, disk_size, download_queue, prefetch_queue, s3_queue: 1002, 0, 70472058, 0, 0, 0
2014-09-25 12:55:56,583 DEBUG new_locks, unused_locks: 0, 0
2014-09-25 12:55:56,583 DEBUG gc count0/threshold0, count1/threshold1, count2/threshold2: 362/700, 2/10, 2/10
2014-09-25 12:55:56,583 DEBUG check_threads 'False'
2014-09-25 12:55:58,566 DEBUG check_cache_size get_memory_usage
2014-09-25 12:55:58,655 DEBUG read awake '/1/2/3172476_1.0.jpg' '127280' '0' '0'
2014-09-25 12:55:58,655 DEBUG get_metadata -> '/1/2/3172476_1.0.jpg' 'attr' 'None'
2014-09-25 12:55:58,656 DEBUG get_metadata <- '/1/2/3172476_1.0.jpg' 'attr' 'None' '{u'st_ctime': 1411636835.0, u'st_mtime': 1411636835.0, u'st_nlink': 1, u'st_mode': 33188, u'st_blksize': 131072, u'st_size': 3728, u'st_gid': 495, u'st_uid': 497, u'st_atime': 1411636835.0}'
2014-09-25 12:55:58,656 DEBUG read '/1/2/3172476_1.0.jpg' '127280' '0' '0' out of range
2014-09-25 12:55:58,656 DEBUG enqueue_download_data '/1/2/3172476_1.0.jpg' 0 127280
2014-09-25 12:55:58,657 DEBUG read wait '/1/2/3172476_1.0.jpg' '127280' '0' '0'
2014-09-25 12:55:58,665 DEBUG download_data '/1/2/3172476_1.0.jpg' 0-10485759 [thread 'Thread-46']
2014-09-25 12:55:58,665 DEBUG get_key from cache '/1/2/3172476_1.0.jpg'
2014-09-25 12:55:58,666 DEBUG type k = '<class 'boto.s3.key.Key'>'
2014-09-25 12:55:58,666 DEBUG dir k = '['BufferSize', 'DefaultContentType', 'RestoreBody', '__class__', '__delattr__', '__dict__', '__doc__', '__format__', '__getattribute__', '__hash__', '__init__', '__iter__', '__module__', '__new__', '__reduce__', '__reduce_ex__', '__repr__', '__setattr__', '__sizeof__', '__slotnames__', '__str__', '__subclasshook__', '__weakref__', '_get_base64md5', '_get_file_internal', '_get_key', '_get_md5', '_get_remote_metadata', '_normalize_metadata', '_send_file_internal', '_set_base64md5', '_set_key', '_set_md5', '_underscore_base_user_settable_fields', 'add_email_grant', 'add_user_grant', 'base64md5', 'base_user_settable_fields', 'bucket', 'cache_control', 'change_storage_class', 'close', 'closed', 'compute_md5', 'content_disposition', 'content_encoding', 'content_language', 'content_type', 'copy', 'delete', 'delete_marker', 'encrypted', 'endElement', 'etag', 'exists', 'expiry_date', 'f', 'filename', 'generate_url', 'get_acl', 'get_contents_as_string', 'get_contents_to_file', 'get_contents_to_filename', 'get_file', 'get_md5_from_hexdigest', 'get_metadata', 'get_redirect', 'get_torrent_file', 'get_xml_acl', 'handle_addl_headers', 'handle_encryption_headers', 'handle_restore_headers', 'handle_version_headers', 'is_latest', 'key', 'last_modified', 'local_hashes', 'make_public', 'md5', 'metadata', 'mode', 'name', 'next', 'ongoing_restore', 'open', 'open_read', 'open_write', 'owner', 'path', 'provider', 'read', 'resp', 'restore', 'send_file', 'set_acl', 'set_canned_acl', 'set_contents_from_file', 'set_contents_from_filename', 'set_contents_from_stream', 'set_contents_from_string', 'set_metadata', 'set_redirect', 'set_remote_metadata', 'set_xml_acl', 'should_retry', 'size', 'source_version_id', 'startElement', 'storage_class', 'update_metadata', 'version_id']'
2014-09-25 12:55:58,667 DEBUG k = '<Key: party,0/0/31/72/47/3172476.jpg/3172476_1.0.jpg>'
2014-09-25 12:55:58,667 DEBUG download_data '/1/2/3172476_1.0.jpg' 0-10485759 [thread 'Thread-46'] already downloading
from yas3fs.
@danilop can you please comment w/ any thoughts as to what could be causing the condition in the latter comment? (i.e. the range read issue)
from yas3fs.
Fixed by #47 merge retry download/read ops configurability to avoid infinite loops
from yas3fs.
Related Issues (20)
- CPU cycles while idling HOT 1
- FUSE permission handling has changed, --no-default-permissions is undocumented
- Include either mountpoint or bucket name in cache-status messages
- --cache-check N seems not to work
- EFAULT bad address in system call argument HOT 4
- ca-central-1 not supported?
- Feature: File Level Encryption
- Mounting public buckets
- Digital Ocean compatible? HOT 5
- Unsupported UTF-8 characters HOT 1
- Trouble Mounting S3 Bucket Inside Docker Container HOT 2
- MacOSX 10.15.4 makes yas3fs read-only?
- Broken package in pypi HOT 1
- /etc/fstab support for ubuntu 18.04 HOT 1
- Big Sur compatibility? HOT 2
- Please tag and push new versions to pip
- Pip install no longer working HOT 1
- Unable to `pip install yas3fs` on Ubuntu server HOT 3
- Backblaze B2 S3 API HOT 1
- Undocumented requests package version requirement HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from yas3fs.