[tahoe-dev] Upload error

[Ed Kapitein]

On Fri, 2013-07-05 at 00:10 +0200, Ed Kapitein wrote:
> Hi sometimes when i upload a file i get an error like this one:
> 
> 
> 
> <type 'exceptions.KeyError'>: (9, '\x7f\x07\x14\xb8\xcaj\x17`\x03\xb0
> \xb8\xc42(2\x10\xc1\xaa\x85\x88\x03\xcd\xb6\xb7\xa6\x89\x92\xbf\xd0
> \xc8(\xea', '\xd0\xdd\x95\x93\x94#\xce\xb9\xaaG6\x9f\xe1\x8e\x19\x9c',
> 1083, 1083, 3, 5, '\x00\x00\x00\x00\x00\x00\x00\x00\t\x7f\x07\x14\xb8
> \xcaj\x17`\x03\xb0\xb8\xc42(2\x10\xc1\xaa\x85\x88\x03\xcd\xb6\xb7\xa6
> \x89\x92\xbf\xd0\xc8(\xea\xd0\xdd\x95\x93\x94#\xce\xb9\xaaG6\x9f\xe1
> \x8e\x19\x9c\x03\x05\x00\x00\x00\x00\x00\x00\x04;\x00\x00\x00\x00\x00
> \x00\x04;', (('enc_privkey', 1150), ('EOF', 2365), ('share_data',
> 789), ('signature', 399), ('block_hash_tree', 757),
> ('share_hash_chain', 655)))
> 

> 285 
> # this sharemap is consumed as we decide to send requests
> <type 'exceptions.KeyError'>: (9, '\x7f\x07\x14\xb8\xcaj\x17`\x03\xb0
> \xb8\xc42(2\x10\xc1\xaa\x85\x88\x03\xcd\xb6\xb7\xa6\x89\x92\xbf\xd0
> \xc8(\xea', '\xd0\xdd\x95\x93\x94#\xce\xb9\xaaG6\x9f\xe1\x8e\x19\x9c',
> 1083, 1083, 3, 5, '\x00\x00\x00\x00\x00\x00\x00\x00\t\x7f\x07\x14\xb8
> \xcaj\x17`\x03\xb0\xb8\xc42(2\x10\xc1\xaa\x85\x88\x03\xcd\xb6\xb7\xa6
> \x89\x92\xbf\xd0\xc8(\xea\xd0\xdd\x95\x93\x94#\xce\xb9\xaaG6\x9f\xe1
> \x8e\x19\x9c\x03\x05\x00\x00\x00\x00\x00\x00\x04;\x00\x00\x00\x00\x00
> \x00\x04;', (('enc_privkey', 1150), ('EOF', 2365), ('share_data',
> 789), ('signature', 399), ('block_hash_tree', 757),
> ('share_hash_chain', 655)))
><SNIP><
> I am trying this in the pubgrid, wit 3-7-10 encoding and connected to
> 13 of 40 known storage servers. 
> 
> 
> 
> And after a couple of tries it just works.
> 
> 
> Any idea what goes wrong here?
> i am running 1.10.0 on a RPI.
> 
> 
> Kind regards,
> Ed
> 
> 

After a few tries the file did upload, and shortly after the directory i
was uploading the file into got corrupted.
A check on the directory shows:

Not Recoverable! : Unhealthy: some versions are unrecoverable no
versions are recoverable
      * Report: 
        Unrecoverable Versions: 1*seq29-c4pi/1*seq25-fgqg/2*seq30-utox
        Unhealthy: some versions are unrecoverable
        Unhealthy: no versions are recoverable
      * Share Counts: need 3-of-5, have 1
      * Hosts with good shares: 1
      * Corrupt shares: none
      * Wrong Shares: 3
      * Good Shares (sorted in share order): 
        
Any idea why a good working directory would disappear after a few failed
uploads of files into that directory?

the directory that is corrupted is the htdocs directory in
URI:DIR2:xyixata7yq5lx5w755azwag5ni:jwdanyzc3sph2up6zndyhlvtx4eqv5jgqknhysiwqyqskyp6ozyq
on the pubgrid.


allmydata-tahoe: 1.10.0
foolscap: 0.6.4
pycryptopp: 0.6.0.1206569328141510525648634803928199668821045408958
zfec: 1.4.5
Twisted: 12.0.0
Nevow: 0.10.0
zope.interface: unknown
python: 2.7.3
platform: Linux-debian_7.0-armv6l-32bit_ELF
pyOpenSSL: 0.13
simplejson: 2.5.2
pycrypto: 2.6
pyasn1: unknown
mock: 0.8.0
setuptools: 0.6c16dev4

I did put the incidents in
URI:DIR2:y5cb3lvk47wj2vk2fuo5ytdtha:s3kbuweuopul74h2zhdom52qqb64jboqumv4nf3sikkbfauizkwq
on the pubgrid ( the incidents directory next to the htdocs directory )

Kind regards,
Ed

PS
i was using 3-5-5 encoding at the time not 3-7-10 as mentioned earlier.