initial (44cbbee5) | Commits | Mateusz Kopeć / DistSys

Browse Code »

Commit 44cbbee54dc5c5b714b914d91509f922cd9e7bed

Authored by Mateusz Kopeć 12 years ago

0 parents

master

initial

Inline Side-by-side

Showing 68 changed files with 7693 additions and 0 deletions

Too many changes to show.
Reload with full diff Plain diff Email patch

To preserve performance only 49 of 68 files are displayed.

README 0 → 100644

View file @44cbbee

	1	+++ a/README
	1	+Instrukcja instalacji systemu zarządzania plikami.
	2	+
	3	+
	4	+W poniższej instrukcji zakładamy, że czytelnik posiada podstawową
	5	+wiedzę na temat administracji serwera svn. Zakładamy, że
	6	+po stronie serwera zainstalowane są następujące narzędzia:
	7	+
	8	+* subversion
	9	+* python (2.6 lub 2.7)
	10	+* pysvn
	11	+
	12	+GUI ułatwiające pobieranie i wysyłanie zaanotowanych plików
	13	+zbudowane jest na bazie:
	14	+
	15	+* python
	16	+* wxPython
	17	+* wxGlade
	18	+
	19	+Przygotowana została binarna wersja GUI pod system Windows,
	20	+dzięki czemu użytkownicy systemu nie muszą posiadać
	21	+zainstalowanych powyższych narzedzi.
	22	+
	23	+
	24	+------------------------------------------------------------------
	25	+
	26	+
	27	+Razem z instrukcją README administrator systemu powinien otrzymać:
	28	+
	29	+* Moduł dfs -- implementację systemu zarządzania plikami,
	30	+* Katalog scripts -- zestaw skryptów ułatwiających tworzenie i
	31	+ zarządzanie systemem,
	32	+* Moduł gui -- implementację GUI dla użytkowników systemu.
	33	+* Katalog z przykładową konfiguracją serwera
	34	+ (pliki $SERVER.cfg oraz $USERS.cfg),
	35	+* Katalog z przykładową konfiguracją klienta GUI (plik $GUI.cfg).
	36	+
	37	+Ponadto, administrator powinien wygenerować klucze szyfrujące
	38	+połączenie klient-serwer -- pliki key.pem i cert.pem.
	39	+Odpowiednie informacje na temat generowania kluczy można znaleźć
	40	+pod adresem:
	41	+
	42	+http://docs.python.org/dev/library/ssl.html#certificates
	43	+
	44	+
	45	+==================================================================
	46	+
	47	+
	48	+1) Zakładanie nowego repozytorium.
	49	+
	50	+
	51	+Na serwerze, w katalogu, w którym ma znajdować się repozytorium,
	52	+należy wykonać komendę:
	53	+
	54	+$ svnadmin create $REPO.PATH
	55	+
	56	+W katalogu konfiguracyjnym repozytorium ($REPO.PATH/conf/) należy
	57	+zmodyfikować dwa pliki:
	58	+
	59	+i) svnserve.conf
	60	+
	61	+...
	62	+### and "none". The sample settings below are the defaults.
	63	+anon-access = none
	64	+auth-access = write
	65	+### The password-db option controls the location of the password
	66	+...
	67	+### Uncomment the line below to use the default password file.
	68	+password-db = passwd
	69	+### The authz-db option controls the location of the authorization
	70	+...
	71	+
	72	+ii) passwd
	73	+
	74	+W pliku passwd należy wpisać login i hasło, które wykorzystywane
	75	+będą po stronie serwera do zatwierdzania (commit-owania) zmian
	76	+w repozytorium, np.:
	77	+
	78	+...
	79	+machine = 95mnf83m-SDT%@vf
	80	+...
	81	+
	82	+Ten sam login i hasło należy podać w konfiguracji serwera systemu
	83	+zarządzania plikami, o czym w punkcie 2). W pliku passwd można
	84	+podać również hasła dla innych użytkowników repozytorium -- więcej
	85	+na ten temat można znaleźć w dokumentacji subversion.
	86	+
	87	+Hasła użytkowników systemu (anotatorów) również uzupełniane są w
	88	+konfiguracji systemu zarządzania plikami opisanej w 2).
	89	+
	90	+
	91	+------------------------------------------------------------------
	92	+
	93	+
	94	+Na serwerze, w innym katalogu niż zostało założone repozytorium,
	95	+należy utworzyć kopię roboczą repozytorium, z której korzystać
	96	+będzie system zarządzania plikami. W tym celu należy wpisać:
	97	+
	98	+$ svn co file://$REPO.PATH $COPY.PATH
	99	+Pobrano wersję 0.
	100	+
	101	+Gdzie $REPO.PATH to ścieżka repozytorium, a $COPY.PATH to
	102	+docelowy katalog kopii roboczej.
	103	+
	104	+
	105	+UWAGA: Zamiast ścieżki postaci file://$REPO.PATH, można również
	106	+podać adres w postaci svn://$REPO.ADDR -- adres, który jest
	107	+dostępny dla użytkowników repozytorium pracujących poza
	108	+serwerem. Ponadto, kopię roboczą można założyć na innym
	109	+serwerze niż repozytorium. Kopia robocza musi jednak znajdować
	110	+się na tej samej maszynie, na której będzie później uruchamiany
	111	+serwer systemu zarządzania plikami. Wadą tego rozwiązania
	112	+może być wolniejsze działanie systemu.
	113	+
	114	+
	115	+Pustą kopię roboczą należy na wstępie wypełnić strukturą katalogów
	116	+dla systemu zarządzania plikami. Służy do tego skrypt
	117	+fill_empty_repo.sh znajdujący się w katalogu scripts dostarczonym
	118	+razem z tą instrukcją. Skrypt wywołuje się w następujący sposób:
	119	+
	120	+$ ./fill_empty_repo.sh $COPY.PATH
	121	+
	122	+Struktura katalogów powinna wyglądać następująco:
	123	+
	124	+$COPY.PATH/
	125	+ new <- katalog z nowymi plikami
	126	+ annotation/ <- wyniki anotacji plików
	127	+ A
	128	+ B
	129	+ adjudication <- wyniki super-anotacji plików
	130	+ db.xml <- baza danych z bierzącymi informacjami
	131	+ dotyczącymi anotacji
	132	+
	133	+Na koniec należy watwierdzić zmiany wykonane w kopii roboczej:
	134	+
	135	+$ svn add $COPY.PATH/*
	136	+$ svn commit --username=machine --password=95mnf83m-SDT%@vf -m "struktura"
	137	+
	138	+
	139	+UWAGA: W katalogach annotation/A, annotation/B oraz adjudication
	140	+znajdują się wysłane przez anotatorów na serwer pliki. Nie oznacza
	141	+to jednak, że anotacja tych plików przez ich posiadaczy zakończyła
	142	+się. Taką informację można uzyskać na podstawie bazy danych
	143	+(pliki, których anotacja/super-anotacja zakończyła się, będą
	144	+uzupełnione o element <checkinDate> w bazie danych).
	145	+
	146	+
	147	+==================================================================
	148	+
	149	+
	150	+2) Konfiguracja systemu zarządzania plikami.
	151	+
	152	+
	153	+Konfiguracja systemu odbywa się w trzech plikach:
	154	+* $SERVER.cfg
	155	+* $USERS.cfg
	156	+* $PASSWD
	157	+
	158	+Razem z instrukcją i implementacją serwera powinny zostać
	159	+dostarczone również przykładowe pliki konfiguracyjne, w których
	160	+można znaleźć dokładniejsze informacje na temat konfiguracji
	161	+serwera.
	162	+
	163	+i) $SERVER.cfg
	164	+
	165	+Plik $SERVER.cfg jest głównym plikiem konfiguracyjnym i jedynym
	166	+wczytywanym bezpośrednio przez serwer systemu (znajdują się
	167	+w nim również ścieżki do pozostałych dwóch plików konfiguracyjnych
	168	+-- $USERS.cfg i $PASSWD).
	169	+
	170	+ii) $USERS.cfg
	171	+
	172	+Plik zawiera informacje o uprawnieniach do super-anotacji oraz
	173	+o limitach pobierania plików.
	174	+
	175	+ii) $PASSWD
	176	+
	177	+W pliku znajdują się hasła określone dla użytkowników systemu
	178	+(anotatorów). Poszczególne linie tego pliku mają postać:
	179	+login = hasło
	180	+
	181	+
	182	+==================================================================
	183	+
	184	+
	185	+3) Używanie serwera systemu zarzadznania plikami.
	186	+
	187	+
	188	+Do uruchamiania serwera służy narzędzie server.py w module dfs.
	189	+Serwer uruchamia się następującą komendą:
	190	+
	191	+$ python server.py $SERVER.cfg
	192	+
	193	+Ewentualne błędy będą wypisywane na standardowe wyjście.
	194	+
	195	+
	196	+------------------------------------------------------------------
	197	+
	198	+
	199	+Karmienie systemu nowymi plikami przeznaczonymi do anotacji.
	200	+
	201	+Do tego celu służy skrypt add_files.py w katalogu scripts.
	202	+
	203	+$ python add_files.py $SERVER.cfg PATH1 PATH2 ...
	204	+
	205	+gdzie PATH1, PATH2, ... to ścieżki do plików, które mają zostać
	206	+dodane do repozytorium. Zmiany nie są automatycznie commit-owane,
	207	+więc trzeba użyć komendy svn commit do ich zatwierdzenia:
	208	+
	209	+UWAGA: Dodawanie plików, jak również jakiekolwiek prace
	210	+administracyje w repozytorium systemu powinny być przeprowadzane
	211	+przy wyłączonym serwerze server.py. Serwer można w sposób
	212	+bezpieczny wyłączyć wysyłając sygnał SIGINT (np. Control-C)
	213	+(Sygnał zostanie zignorowany, jeśli odbywa się komunikacja
	214	+z serwerem).
	215	+
	216	+
	217	+==================================================================
	218	+
	219	+
	220	+4) Graficzny interfejs systemu zarządzania plikami.
	221	+
	222	+
	223	+Implementacja GUI znajduje się w module gui dostarczonym
	224	+razem z instrukcją. GUI przeznaczone jest dla użytkowników
	225	+systemu, czyli anotatorów.
	226	+
	227	+
	228	+------------------------------------------------------------------
	229	+
	230	+
	231	+Konfiguracja GUI znajduje się w katalogu gui/data w pliku
	232	+global.cfg. W tym samym katalogu powinien znajdować się
	233	+wygenerowany przez administratora klucz publiczny (cert.pem).
	234	+Dokładniejsze informacje na temat konfiguracji znajdują się w
	235	+przykładowym pliku konfiguracyjnym gui/data/global.cfg.
	236	+
	237	+
	238	+------------------------------------------------------------------
	239	+
	240	+
	241	+GUI uruchamia się komendą:
	242	+
	243	+$ python manager.py
...	...

dfs/__init__.py 0 → 100644

View file @44cbbee

	1	+++ a/dfs/__init__.py
...	...

dfs/config.py 0 → 100644

View file @44cbbee

	1	+++ a/dfs/config.py
	1	+# -- coding: utf-8 --
	2	+import re
	3	+import os
	4	+
	5	+SECTION = re.compile("^\[(.*)\]$")
	6	+SUBSECTION = re.compile("^\{(.*)\}$")
	7	+ENTRY = re.compile("^([^=\s]+)\s=\s([^=]+)\s*$")
	8	+
	9	+def cut_comment(s):
	10	+ return s.split("#")[0]
	11	+
	12	+class Config:
	13	+
	14	+ def __init__(self, path):
	15	+ section = None
	16	+ subsection = None
	17	+ self.d = {}
	18	+ with open(path) as f:
	19	+ for line in f:
	20	+ line = cut_comment(line).strip()
	21	+
	22	+ m = SECTION.search(line)
	23	+ if m is not None:
	24	+ section = m.group(1)
	25	+ subsection = None
	26	+ continue
	27	+
	28	+ m = SUBSECTION.search(line)
	29	+ if m is not None:
	30	+ subsection = m.group(1)
	31	+ continue
	32	+
	33	+ m = ENTRY.search(line)
	34	+ if m is not None:
	35	+ key = m.group(1)
	36	+ val = m.group(2)
	37	+ if subsection == "paths":
	38	+ # print path, val, os.path.join(path, val)
	39	+ val = self.relative_path(val, path)
	40	+ if section is not None:
	41	+ self.d[section + "." + key] = val
	42	+ else:
	43	+ self.d[key] = val
	44	+
	45	+ def relative_path(self, path, ref):
	46	+ return os.path.join(os.path.dirname(ref), path)
	47	+
	48	+ def __getitem__(self, key):
	49	+ return self.d[key]
...	...

dfs/database.py 0 → 100644

View file @44cbbee

	1	+++ a/dfs/database.py
	1	+# -- coding: utf-8 --
	2	+import time
	3	+from datetime import date, datetime
	4	+from collections import defaultdict
	5	+
	6	+from xml.etree.ElementTree import Element, ElementTree, tostring
	7	+import xml.etree.ElementTree as ET
	8	+
	9	+class Database:
	10	+
	11	+ def __init__(self, db, anno_per_file, from_file=True):
	12	+ if from_file:
	13	+ self.db_name = db
	14	+ self.tree = ET.parse(db)
	15	+ self.root = self.tree.getroot()
	16	+ else:
	17	+ self.db_name = None
	18	+ self.tree = None
	19	+ self.root = ET.fromstring(db)
	20	+
	21	+ self.anno_per_file = anno_per_file
	22	+ self.make_index()
	23	+
	24	+ def owned(self, ann_elem):
	25	+ return not self.finished(ann_elem) and not self.returned(ann_elem)
	26	+
	27	+ def finished(self, ann_elem):
	28	+ return ann_elem.find("checkinDate") is not None
	29	+
	30	+ def returned(self, ann_elem):
	31	+ return ann_elem.find("return") is not None
	32	+
	33	+ def get_reason(self, ann_elem):
	34	+ reas = ann_elem.find("return").find("reason").text
	35	+ if reas is None:
	36	+ reas = ""
	37	+ return reas
	38	+
	39	+ def rejected(self, file_elem):
	40	+ return file_elem.find("rejected") is not None
	41	+
	42	+ def fixed(self, ann_elem):
	43	+ ret = ann_elem.find("return")
	44	+ if ret is not None and ret.find("fixed") is not None:
	45	+ return True
	46	+ return False
	47	+
	48	+ def ann_elem_for_user(self, file_elem, user):
	49	+ idx = 0
	50	+ for ann_elem in file_elem.findall("ann"):
	51	+ if ann_elem.find("annName").text == user:
	52	+ return ann_elem, idx
	53	+ idx = idx + 1
	54	+ return None, None
	55	+
	56	+ def sann_elem_for_user(self, file_elem, user):
	57	+ for ann_elem in file_elem.findall("s_ann"):
	58	+ if ann_elem.find("annName").text == user:
	59	+ return ann_elem
	60	+ return None
	61	+
	62	+ def fixed_for_user(self, file_elem, user, is_adj):
	63	+ if is_adj:
	64	+ ann = self.sann_elem_for_user(file_elem, user)
	65	+ else:
	66	+ ann, idx = self.ann_elem_for_user(file_elem, user)
	67	+ if ann is not None:
	68	+ return self.fixed(ann)
	69	+ return False
	70	+
	71	+ def make_index(self):
	72	+ self.file_index = {}
	73	+ self.ann_owned_index = defaultdict(list)
	74	+ self.adj_owned_index = defaultdict(list)
	75	+
	76	+ for file_elem in self.root:
	77	+ name_elem = file_elem.find("name")
	78	+ if name_elem == None:
	79	+ raise Exception("No name assigned to a file element !")
	80	+ self.file_index[name_elem.text] = file_elem
	81	+
	82	+ if self.rejected(file_elem):
	83	+ continue
	84	+
	85	+ for ann_elem in file_elem.findall("ann"):
	86	+ if self.owned(ann_elem):
	87	+ ann_name = ann_elem.find("annName").text
	88	+ self.ann_owned_index[ann_name].append(file_elem)
	89	+
	90	+ for ann_elem in file_elem.findall("s_ann"):
	91	+ if self.owned(ann_elem):
	92	+ ann_name = ann_elem.find("annName").text
	93	+ self.adj_owned_index[ann_name].append(file_elem)
	94	+
	95	+ def fix(self, ann_elem):
	96	+ if not self.returned(ann_elem):
	97	+ raise Exception("File not returned in database!")
	98	+ if self.fixed(ann_elem):
	99	+ raise Exception("File already fixed in database!")
	100	+
	101	+ ret = ann_elem.find("return")
	102	+ fixed = ET.SubElement(ret, "fixed")
	103	+
	104	+ def add(self, file_name):
	105	+ if self.file_index.has_key(file_name):
	106	+ raise Exception("File name already in database !")
	107	+ file_elem = ET.SubElement(self.root, "file")
	108	+ name_elem = ET.SubElement(file_elem, "name")
	109	+ name_elem.text = file_name
	110	+ date_elem = ET.SubElement(file_elem, "addDate")
	111	+ date_elem.text = time.strftime("%c")
	112	+ self.file_index[file_name] = file_elem
	113	+
	114	+ def remove(self, file_name):
	115	+ if not self.file_index.has_key(file_name):
	116	+ raise Exception("File name not in database !")
	117	+ file_elem = self.file_index[file_name]
	118	+ self.root.remove(file_elem)
	119	+ self.make_index()
	120	+
	121	+ def reject(self, file_name, reason):
	122	+ if not self.file_index.has_key(file_name):
	123	+ raise Exception("File name not in database !")
	124	+ file_elem = self.file_index[file_name]
	125	+ if self.rejected(file_elem):
	126	+ raise Exception("File already rejected !")
	127	+ rej_elem = ET.SubElement(file_elem, "rejected")
	128	+ rej_elem.text = reason
	129	+ self.make_index()
	130	+
	131	+ # For prettyprint, used in 'save' method.
	132	+ def indent(self, elem, level=0):
	133	+ i = "\n" + level * " "
	134	+ if len(elem):
	135	+ if not elem.text or not elem.text.strip():
	136	+ elem.text = i + " "
	137	+ if not elem.tail or not elem.tail.strip():
	138	+ elem.tail = i
	139	+ for elem in elem:
	140	+ self.indent(elem, level + 1)
	141	+ if not elem.tail or not elem.tail.strip():
	142	+ elem.tail = i
	143	+ else:
	144	+ if level and (not elem.tail or not elem.tail.strip()):
	145	+ elem.tail = i
	146	+
	147	+ def save(self):
	148	+ if not self.db_name:
	149	+ raise Exception("XML not read from file !")
	150	+
	151	+ self.indent(self.root)
	152	+ self.tree.write(self.db_name, encoding="utf-8")
	153	+
	154	+ def upload_prevention(self, file_name, user, is_super):
	155	+ if not self.file_index.has_key(file_name):
	156	+ return "Filename " + file_name.encode('utf-8') + " not known by server."
	157	+ file_elem = self.file_index[file_name]
	158	+ if self.rejected(file_elem):
	159	+ return "File rejected: " + file_name.encode('utf-8')
	160	+
	161	+ if is_super:
	162	+ ann_elem = file_elem.find("s_ann")
	163	+ if ann_elem is None:
	164	+ return "No superannotator assigned to file " + file_name.encode('utf-8')
	165	+
	166	+ if user != ann_elem.find("annName").text:
	167	+ return "Different superannotator assigned to file " + file_name.encode('utf-8')
	168	+
	169	+ if ann_elem.find("checkinDate") is not None:
	170	+ return "File " + file_name.encode('utf-8') + " already checked in!"
	171	+
	172	+ return None
	173	+
	174	+ else:
	175	+ annotations = file_elem.findall("ann")
	176	+ owners = map(lambda ann: ann.find("annName").text, annotations)
	177	+ if not user in owners:
	178	+ return "User " + user + " doesn't own the file " + file_name.encode('utf-8')
	179	+
	180	+ i = owners.index(user)
	181	+ ann_elem = annotations[i]
	182	+ if ann_elem.find("checkinDate") is not None:
	183	+ return "User " + user + " already checked in the file " + file_name.encode('utf-8')
	184	+
	185	+ return None
	186	+
	187	+ def upload_dest(self, file_name, user):
	188	+ """Upload destination (annName element and ID -- 1 or 2) directory."""
	189	+ file_elem = self.file_index[file_name]
	190	+ annotations = file_elem.findall("ann")
	191	+
	192	+ owners = map(lambda ann: ann.find("annName").text, annotations)
	193	+ exc = Exception("Cannot upload " + file_name.encode('utf-8')
	194	+ + " file by " + user + " annotator !")
	195	+ if not user in owners:
	196	+ raise exc
	197	+
	198	+ i = owners.index(user)
	199	+ ann_elem = annotations[i]
	200	+ if ann_elem.find("checkinDate") is not None:
	201	+ raise exc
	202	+
	203	+ return (ann_elem, i)
	204	+
	205	+ def upload_id(self, file_name, user):
	206	+ return self.upload_dest(file_name, user)[1]
	207	+
	208	+ def return_file(self, file_name, user, reason):
	209	+ (ann_elem, i) = self.upload_dest(file_name, user)
	210	+ ret_elem = ET.SubElement(ann_elem, "return")
	211	+ date_elem = ET.SubElement(ret_elem, "date")
	212	+ date_elem.text = time.strftime("%c")
	213	+ date_elem = ET.SubElement(ret_elem, "reason")
	214	+ if reason is None:
	215	+ reason = ""
	216	+ date_elem.text = reason
	217	+ return i
	218	+
	219	+ def return_file_prim(self, file_name, user, reason):
	220	+ file_elem = self.file_index[file_name]
	221	+ ann_elem = file_elem.find("s_ann")
	222	+
	223	+ if (user != ann_elem.find("annName").text or
	224	+ ann_elem.find("checkinDate") is not None):
	225	+ raise Exception("Cannot upload " + file_name.encode('utf-8')
	226	+ + " file by " + user + " annotator !")
	227	+
	228	+ ret_elem = ET.SubElement(ann_elem, "return")
	229	+ date_elem = ET.SubElement(ret_elem, "date")
	230	+ date_elem.text = time.strftime("%c")
	231	+ date_elem = ET.SubElement(ret_elem, "reason")
	232	+ if reason is None:
	233	+ reason = ""
	234	+ date_elem.text = reason
	235	+
	236	+ def upload(self, file_name, user):
	237	+ (ann_elem, i) = self.upload_dest(file_name, user)
	238	+ date_elem = ET.SubElement(ann_elem, "checkinDate")
	239	+ date_elem.text = time.strftime("%c")
	240	+ return i
	241	+
	242	+ def upload_prim(self, file_name, user):
	243	+ file_elem = self.file_index[file_name]
	244	+ ann_elem = file_elem.find("s_ann")
	245	+
	246	+ if (user != ann_elem.find("annName").text or self.finished(ann_elem)):
	247	+ raise Exception("Cannot upload " + file_name.encode('utf-8')
	248	+ + " file by " + user + " annotator !")
	249	+
	250	+ date_elem = ET.SubElement(ann_elem, "checkinDate")
	251	+ date_elem.text = time.strftime("%c")
	252	+
	253	+ def download(self, file_name, user):
	254	+ file_elem = self.file_index[file_name]
	255	+
	256	+ annotations = file_elem.findall("ann")
	257	+ owners = map(lambda ann: ann.find("annName").text, annotations)
	258	+
	259	+ if self.fixed_for_user(file_elem, user, False):
	260	+ ann, idx = self.ann_elem_for_user(file_elem, user)
	261	+ date = ann.find("return").find("date").text
	262	+ ann.remove(ann.find("return"))
	263	+
	264	+ date_elem = ET.SubElement(ann, "returnDate")
	265	+ date_elem.text = date
	266	+
	267	+ date_elem = ET.SubElement(ann, "checkoutDate")
	268	+ date_elem.text = time.strftime("%c")
	269	+
	270	+ return idx
	271	+
	272	+ else:
	273	+ if user in owners or len(owners) + 1 > self.anno_per_file:
	274	+ raise Exception("Cannot set " + user + " annotator to '"
	275	+ + file_name.encode('utf-8') + "' file !")
	276	+
	277	+ ann_elem = ET.SubElement(file_elem, "ann")
	278	+ ann_name_elem = ET.SubElement(ann_elem, "annName")
	279	+ ann_name_elem.text = user
	280	+
	281	+ date_elem = ET.SubElement(ann_elem, "checkoutDate")
	282	+ date_elem.text = time.strftime("%c")
	283	+
	284	+ return None
	285	+
	286	+ def download_prim(self, file_name, user):
	287	+ file_elem = self.file_index[file_name]
	288	+
	289	+ if self.fixed_for_user(file_elem, user, True):
	290	+ sann = self.sann_elem_for_user(file_elem, user)
	291	+ date = sann.find("return").find("date").text
	292	+ sann.remove(sann.find("return"))
	293	+
	294	+ date_elem = ET.SubElement(sann, "returnDate")
	295	+ date_elem.text = date
	296	+
	297	+ date_elem = ET.SubElement(sann, "checkoutDate")
	298	+ date_elem.text = time.strftime("%c")
	299	+
	300	+ return True
	301	+
	302	+ else:
	303	+ if len(file_elem.findall("s_ann")) > 0:
	304	+ raise Exception("Cannot set " + user + " adjudicator to '"
	305	+ + file_name.encode('utf-8') + "' file !")
	306	+
	307	+ ann_elem = ET.SubElement(file_elem, "s_ann")
	308	+ ann_name_elem = ET.SubElement(ann_elem, "annName")
	309	+ ann_name_elem.text = user
	310	+
	311	+ date_elem = ET.SubElement(ann_elem, "checkoutDate")
	312	+ date_elem.text = time.strftime("%c")
	313	+
	314	+ return False
	315	+
	316	+ def for_annotation(self, user):
	317	+ priority = []
	318	+ result = []
	319	+ for file_elem in self.root:
	320	+ if self.rejected(file_elem) or file_elem.find("s_ann") is not None:
	321	+ continue
	322	+
	323	+ anns = file_elem.findall("ann")
	324	+ owners = map(lambda ann: ann.find("annName").text, anns)
	325	+ if len(owners) < self.anno_per_file and user not in owners:
	326	+ result.append(file_elem.find("name").text)
	327	+
	328	+ if self.fixed_for_user(file_elem, user, False):
	329	+ priority.append(file_elem.find("name").text)
	330	+
	331	+ return priority, result
	332	+
	333	+ def for_adjudication(self, user):
	334	+ priority = []
	335	+ result = []
	336	+ for file_elem in self.root:
	337	+ if self.rejected(file_elem):
	338	+ continue
	339	+
	340	+ anns = file_elem.findall("ann")
	341	+ owners = map(lambda ann: ann.find("annName").text, anns)
	342	+ checked = map(lambda ann: ann.find("checkinDate") != None, anns)
	343	+ if (len(owners) == self.anno_per_file
	344	+ and file_elem.find("s_ann") is None
	345	+ and user not in owners
	346	+ and all(checked)):
	347	+ result.append(file_elem.find("name").text)
	348	+
	349	+ if self.fixed_for_user(file_elem, user, True):
	350	+ priority.append(file_elem.find("name").text)
	351	+
	352	+ return priority, result
	353	+
	354	+ def owns_normal(self, user):
	355	+ return [ file_elem.find("name").text
	356	+ for file_elem
	357	+ in self.ann_owned_index[user] ]
	358	+
	359	+ def owns_super(self, user):
	360	+ return [ file_elem.find("name").text
	361	+ for file_elem
	362	+ in self.adj_owned_index[user] ]
	363	+
	364	+ def owns(self, user):
	365	+ return self.owns_normal(user) + self.owns_super(user)
	366	+
	367	+ def finished_count(self, user):
	368	+ n = 0
	369	+ for file_elem in self.root:
	370	+
	371	+ if self.rejected(file_elem):
	372	+ continue
	373	+
	374	+ items = file_elem.findall("ann")
	375	+ items.extend(file_elem.findall("s_ann"))
	376	+ for ann_elem in items:
	377	+ ann_name = ann_elem.find("annName").text
	378	+ if ann_name == user and self.finished(ann_elem) and not self.returned(ann_elem):
	379	+ n += 1
	380	+
	381	+ return n
...	...

dfs/msg/__init__.py 0 → 100644

View file @44cbbee

	1	+++ a/dfs/msg/__init__.py
...	...

dfs/msg/message.py 0 → 100644

View file @44cbbee

	1	+++ a/dfs/msg/message.py
	1	+# -- coding: utf-8 --
	2	+__all__ = ["decode", "Message", "OkMessage", "KoMessage", "DownloadRequest"
	3	+ , "UploadRequest", "DownloadPrimRequest", "ClientDone", "ServerDone"
	4	+ , "NumMessage", "BoolMessage", "ReturnRequest", "CheckoutRequest",
	5	+ "CheckinRequest", "StatsRequest"]
	6	+
	7	+
	8	+class Message(object):
	9	+
	10	+ """
	11	+ Base class for SSL communication messages.
	12	+ """
	13	+
	14	+ def __init__(self, contents=""):
	15	+ self.contents = contents
	16	+
	17	+ def get_contents(self):
	18	+ return self.contents
	19	+
	20	+ @classmethod
	21	+ def from_contents(cls, contents):
	22	+ return cls(contents)
	23	+
	24	+ def encode(self):
	25	+ """
	26	+ Prepare message to be sent over network.
	27	+ WARNING: Do not override this method.
	28	+ """
	29	+ # Add "-" on the beggining to prevent
	30	+ # message contents from being void.
	31	+ return self.msg_type, "-" + self.get_contents()
	32	+
	33	+
	34	+class NumMessage(Message):
	35	+
	36	+ def __init__(self, n):
	37	+ self.number = n
	38	+
	39	+ def get_contents(self):
	40	+ return str(self.number)
	41	+
	42	+ @classmethod
	43	+ def from_contents(cls, contents):
	44	+ return cls(int(contents))
	45	+
	46	+ def get_number(self):
	47	+ return self.number
	48	+
	49	+
	50	+class BoolMessage(Message):
	51	+
	52	+ def __init__(self, b):
	53	+ self.b = b
	54	+
	55	+ def get_contents(self):
	56	+ return "1" if self.b else "0"
	57	+
	58	+ @classmethod
	59	+ def from_contents(cls, contents):
	60	+ return cls(bool(int(contents)))
	61	+
	62	+ def get_boolean(self):
	63	+ return self.b
	64	+
	65	+class ReturnRequest(NumMessage):
	66	+ pass
	67	+
	68	+class CheckoutRequest(Message):
	69	+ pass
	70	+
	71	+class CheckinRequest(NumMessage):
	72	+ pass
	73	+
	74	+class DownloadRequest(NumMessage):
	75	+ pass
	76	+
	77	+class DownloadPrimRequest(NumMessage):
	78	+ pass
	79	+
	80	+class UploadRequest(NumMessage):
	81	+ pass
	82	+
	83	+class OkMessage(Message):
	84	+ pass
	85	+
	86	+class KoMessage(Message):
	87	+ pass
	88	+
	89	+class StatsRequest(Message):
	90	+ pass
	91	+
	92	+class ServerDone(Message):
	93	+ pass
	94	+
	95	+class ClientDone(Message):
	96	+ pass
	97	+
	98	+
	99	+def subclasses(cls):
	100	+ yield cls
	101	+ for child in cls.__subclasses__():
	102	+ for desc in subclasses(child):
	103	+ yield desc
	104	+
	105	+def decode(msg_type, contents):
	106	+ for cls in subclasses(Message):
	107	+ if cls.msg_type == msg_type:
	108	+ # Discard first, dummy character;
	109	+ # Confront Message.encode method.
	110	+ return cls.from_contents(contents[1:])
	111	+
	112	+for i, cls in enumerate(subclasses(Message)):
	113	+ cls.msg_type = i
...	...

dfs/msg/stream.py 0 → 100644

View file @44cbbee

	1	+++ a/dfs/msg/stream.py
	1	+# -- coding: utf-8 --
	2	+import struct
	3	+
	4	+from message import decode
	5	+
	6	+__all__ = ["read_msg", "write_msg", "EndOfStream"]
	7	+
	8	+class EndOfStream(Exception):
	9	+ pass
	10	+
	11	+class BadMessage(Exception):
	12	+ pass
	13	+
	14	+def read_msg(connstream):
	15	+ encoded = read_encoded(connstream)
	16	+ return decode(*encoded)
	17	+
	18	+def accept_msg(connstream, cls):
	19	+ msg = read_msg(connstream)
	20	+ if type(msg) != cls:
	21	+ raise BadMessage("Expected %s, got %s" %
	22	+ (cls.__name__, type(msg).__name__))
	23	+ return msg
	24	+
	25	+def write_msg(connstream, msg):
	26	+ encoded = msg.encode()
	27	+ write_encoded(connstream, *encoded)
	28	+
	29	+def read_encoded(connstream):
	30	+ _type = read_type(connstream)
	31	+ length = read_length(connstream)
	32	+ content = read_content(connstream, length)
	33	+ return _type, content
	34	+
	35	+def write_encoded(connstream, _type, content):
	36	+ write_type(connstream, _type)
	37	+ write_length(connstream, len(content))
	38	+ write_content(connstream, content)
	39	+
	40	+def read_type(connstream):
	41	+ data = read_all(connstream, 1)
	42	+ return struct.unpack("!B", data)[0]
	43	+
	44	+def write_type(connstream, _type):
	45	+ data = struct.pack("!B", _type)
	46	+ write_all(connstream, data)
	47	+
	48	+def read_length(connstream):
	49	+ data = read_all(connstream, 4)
	50	+ return struct.unpack("!L", data)[0]
	51	+
	52	+def write_length(connstream, n):
	53	+ data = struct.pack("!L", n)
	54	+ write_all(connstream, data)
	55	+
	56	+def read_content(connstream, length):
	57	+ return read_all(connstream, length)
	58	+
	59	+def write_content(connstream, content):
	60	+ write_all(connstream, content)
	61	+
	62	+def write_all(connstream, data):
	63	+ k = connstream.write(data)
	64	+ if k != len(data):
	65	+ raise Exception("Did not send all data !")
	66	+
	67	+def read_all(connstream, k):
	68	+ data = ""
	69	+ while k > 0:
	70	+ # part = connstream.read()
	71	+ part = connstream.read(min(k, 1024))
	72	+ if len(part) == 0:
	73	+ raise EndOfStream
	74	+ k -= len(part)
	75	+ # if k < 0:
	76	+ # raise Exception("Received more than expected !")
	77	+ data += part
	78	+ return data
	79	+
...	...

dfs/repo.py 0 → 100644

View file @44cbbee

	1	+++ a/dfs/repo.py
	1	+# -- coding: utf-8 --
	2	+import os
	3	+import shutil
	4	+import pysvn
	5	+
	6	+class Repo:
	7	+
	8	+ def __init__(self, path, login, passwd):
	9	+ self.path = path
	10	+ def get_login(_realm, _username, _may_save):
	11	+ return True, login, passwd, False
	12	+ self.svn = pysvn.Client()
	13	+ self.svn.callback_get_login = get_login
	14	+ self.svn.update(self.path)
	15	+
	16	+ def add(self, src_path):
	17	+ part_name = os.path.basename(src_path)
	18	+ dest_path = os.path.join(self.new_path(), part_name)
	19	+
	20	+ if (not self.svn.info(dest_path) is None) or (os.path.exists(dest_path)):
	21	+ raise Exception(src_path+" already present in repository.")
	22	+
	23	+ shutil.copy(src_path, dest_path)
	24	+ self.svn.add(dest_path)
	25	+
	26	+ def remove(self, filename, anno_per_file):
	27	+ paths = set()
	28	+ paths.add(os.path.join(self.new_path(), filename))
	29	+ for i in range(anno_per_file):
	30	+ paths.add(self.upload_path(filename, i))
	31	+ paths.add(os.path.join(self.finito_path(), filename))
	32	+
	33	+ removed = []
	34	+ for path in paths:
	35	+ if os.path.exists(path):
	36	+ self.svn.remove(path)
	37	+ removed.append(path)
	38	+
	39	+ return removed
	40	+
	41	+ def db_path(self):
	42	+ return os.path.join(self.path, "db.xml")
	43	+
	44	+ def new_path(self):
	45	+ return os.path.join(self.path, "new")
	46	+
	47	+ def ann_path(self, idx):
	48	+ ids = chr(idx+ord('A'))
	49	+ tail = os.path.join("annotation", ids)
	50	+ return os.path.join(self.path, tail)
	51	+
	52	+ def finito_path(self):
	53	+ return os.path.join(self.path, "adjudication")
	54	+
	55	+ def upload_path(self, file_name, idx):
	56	+ return os.path.join(self.ann_path(idx), file_name)
	57	+
	58	+ def upload_prim_path(self, file_name):
	59	+ return os.path.join(self.finito_path(), file_name)
	60	+
	61	+ def read_data(self, path):
	62	+ with open(path) as src:
	63	+ return src.read()
	64	+
	65	+ def read_contents(self, path, exts):
	66	+ contents = {}
	67	+ for ext in exts:
	68	+ contents[ext] = self.read_data(path + ext)
	69	+ return contents
	70	+
	71	+ def write_data(self, path, data):
	72	+ with open(path, "w") as dest:
	73	+ dest.write(data)
	74	+
	75	+ def write_contents(self, path, contents):
	76	+ for ext, data in contents.iteritems():
	77	+ dest_path = path + ext
	78	+ self.write_data(dest_path, data)
	79	+ if self.svn.info(dest_path) is None:
	80	+ self.svn.add(dest_path)
	81	+
	82	+ def upload(self, file_id, idx, contents):
	83	+ self.write_contents(self.upload_path(file_id, idx), contents)
	84	+
	85	+ def upload_prim(self, file_id, contents):
	86	+ self.write_contents(self.upload_prim_path(file_id), contents)
	87	+
	88	+ def download(self, file_id, exts):
	89	+ return self.read_contents(os.path.join(self.new_path(), file_id), exts)
	90	+
	91	+ def download_prim(self, file_id, exts, anno_per_file):
	92	+ result = []
	93	+ for i in range(anno_per_file):
	94	+ conts = self.read_contents(os.path.join(self.ann_path(i), file_id), exts)
	95	+ result.append(conts)
	96	+ return result
	97	+
	98	+ def checkout(self, file_id, idx, exts):
	99	+ src_paths = [ self.upload_path(file_id, idx)
	100	+ , os.path.join(self.new_path(), file_id) ]
	101	+ for path in src_paths:
	102	+ if all(os.path.exists(path + ext) for ext in exts):
	103	+ return self.read_contents(path, exts)
	104	+
	105	+ def checkout_prim(self, file_id, exts):
	106	+ path = os.path.join(self.finito_path(), file_id)
	107	+ if all(os.path.exists(path + ext) for ext in exts):
	108	+ return self.read_contents(path, exts)
	109	+
	110	+ def commit(self, message):
	111	+ self.svn.checkin(self.path, message, recurse=True)
	112	+
	113	+ def revert(self):
	114	+ self.svn.revert(self.path, recurse=True)
...	...

dfs/server.py 0 → 100644

View file @44cbbee

	1	+++ a/dfs/server.py
	1	+# -- coding: utf-8 --
	2	+import sys
	3	+import os
	4	+import traceback
	5	+import socket, ssl
	6	+import random
	7	+from optparse import OptionParser
	8	+import signal
	9	+
	10	+from utils import validate_user, UserInvalid, send_contents, receive_contents
	11	+from msg.stream import read_msg, write_msg, accept_msg, EndOfStream, BadMessage
	12	+from msg.message import *
	13	+from repo import Repo
	14	+from database import Database
	15	+from config import Config
	16	+
	17	+class SSLServer:
	18	+
	19	+ def __init__(self, host, port, backlog, cert_file, key_file,
	20	+ repository, svn_login, svn_passwd, pass_file,
	21	+ users_file, file_exts, anno_per_file, log=None):
	22	+ """
	23	+ Initialize SSL server.
	24	+
	25	+ params:
	26	+ =======
	27	+ host : str
	28	+ Host name.
	29	+ port : int
	30	+ Port number.
	31	+ backlog : int
	32	+ Maximum number of waiting connections.
	33	+ cert_file : path
	34	+ Public PEM certificate.
	35	+ key_file : path
	36	+ Private key.
	37	+ pass_file : path
	38	+ File with client passwords.
	39	+ users_file : path
	40	+ File with additional users configuration.
	41	+ repository : path
	42	+ Subversion working copy.
	43	+ svn_login : str
	44	+ Subversion login.
	45	+ svn_passwd : str
	46	+ Subversion password.
	47	+ file_exts : [str]
	48	+ List of file extensions.
	49	+ anno_per_file : int
	50	+ Number of normal annotators per file (1 or 2)
	51	+ """
	52	+ self.cert_file = cert_file
	53	+ self.key_file = key_file
	54	+ self.pass_file = pass_file
	55	+ self.users_file = users_file
	56	+ self.wc = Repo(repository, svn_login, svn_passwd)
	57	+ self.file_exts = file_exts
	58	+ if log is not None:
	59	+ self.log = open(log, "a")
	60	+ else:
	61	+ self.log = sys.stdout
	62	+ self.bound = bind_socket(host, port, backlog=backlog)
	63	+ self.serving = None
	64	+ self.anno_per_file = anno_per_file
	65	+
	66	+ def run(self):
	67	+ while True:
	68	+ newsocket, fromaddr = self.bound.accept()
	69	+ self.serving = fromaddr
	70	+ connstream = None
	71	+ try:
	72	+ connstream = ssl.wrap_socket(newsocket,
	73	+ server_side=True,
	74	+ certfile=self.cert_file,
	75	+ keyfile=self.key_file,
	76	+ ssl_version=ssl.PROTOCOL_TLSv1)
	77	+
	78	+ login = validate_user(connstream, self.pass_file)
	79	+ self.serve_client(connstream, login)
	80	+ except UserInvalid as login:
	81	+ print >> self.log, "AUTH ERROR:", login
	82	+ except BadMessage as info:
	83	+ print >> self.log, "BAD MESSAGE ERROR:", info
	84	+ print >> self.log, traceback.format_exc().strip()
	85	+ except EndOfStream:
	86	+ print >> self.log, "UNEXPECTED END OF STREAM:"
	87	+ print >> self.log, traceback.format_exc().strip()
	88	+ except:
	89	+ print >> self.log, "UNEXPECTED ERROR:"
	90	+ print >> self.log, traceback.format_exc().strip()
	91	+ finally:
	92	+ try:
	93	+ if not connstream is None:
	94	+ connstream.shutdown(socket.SHUT_RDWR)
	95	+ except:
	96	+ print >> self.log, "UNEXPECTED ERROR:"
	97	+ print >> self.log, traceback.format_exc().strip()
	98	+ finally:
	99	+ if not connstream is None:
	100	+ connstream.close()
	101	+ self.serving = None
	102	+
	103	+ def exit(self):
	104	+ if self.serving is not None:
	105	+ print ("Client from %s connected to the server"
	106	+ % str(self.serving))
	107	+ else:
	108	+ sys.exit(0)
	109	+
	110	+ def process_msg(self, msg, stream, login):
	111	+ if type(msg) == UploadRequest:
	112	+ self.process_upload_msg(msg, stream, login, checkin=False)
	113	+ elif type(msg) == CheckinRequest:
	114	+ self.process_upload_msg(msg, stream, login, checkin=True)
	115	+ elif type(msg) == CheckoutRequest:
	116	+ self.process_checkout_msg(msg, stream, login)
	117	+ elif type(msg) == DownloadRequest:
	118	+ self.process_download_msg(msg, stream, login)
	119	+ elif type(msg) == DownloadPrimRequest:
	120	+ self.process_download_prim_msg(msg, stream, login)
	121	+ elif type(msg) == ReturnRequest:
	122	+ self.process_return_msg(msg, stream, login)
	123	+ elif type(msg) == StatsRequest:
	124	+ self.process_stats_msg(msg, stream, login)
	125	+ else:
	126	+ print >> self.log, login, "sent:", msg
	127	+
	128	+ def process_return_msg(self, msg, stream, login):
	129	+ reason = accept_msg(stream, Message).get_contents().decode("utf-8")
	130	+
	131	+ usr_cfg = Config(self.users_file)
	132	+ try:
	133	+ user_adj = login in usr_cfg["auth.adjudicators"].split()
	134	+ except KeyError:
	135	+ user_adj = False
	136	+
	137	+ db = Database(self.wc.db_path(), self.anno_per_file)
	138	+ n = msg.get_number()
	139	+ for _ in range(n):
	140	+ file_id = accept_msg(stream, Message).get_contents()
	141	+ is_adj = accept_msg(stream, BoolMessage).get_boolean()
	142	+ if is_adj and not user_adj:
	143	+ write_msg(stream, KoMessage())
	144	+ print >> self.log, "Upload error - user " + login + " tried to upload super annotated file " + file_id + " but is not a super annotator"
	145	+ continue
	146	+ else:
	147	+ error = db.upload_prevention(file_id, login, is_adj)
	148	+ if error is not None:
	149	+ write_msg(stream, KoMessage())
	150	+ print >> self.log, "Upload error by user " + login + ". Details: "+error
	151	+ continue
	152	+
	153	+ write_msg(stream, OkMessage())
	154	+ contents = receive_contents(stream)
	155	+ for key in contents.keys():
	156	+ if key not in self.file_exts:
	157	+ print >> self.log, "Skipped file uploaded by user " + login + ". Filename:"+file_id+key
	158	+ del contents[key]
	159	+
	160	+ if is_adj is False:
	161	+ idx = db.return_file(file_id, login, reason)
	162	+ self.wc.upload(file_id, idx, contents)
	163	+ else:
	164	+ db.return_file_prim(file_id, login, reason)
	165	+ self.wc.upload_prim(file_id, contents)
	166	+
	167	+ db.save()
	168	+ accept_msg(stream, ClientDone)
	169	+ self.wc.commit("return request from %s"
	170	+ % (login))
	171	+ write_msg(stream, ServerDone())
	172	+
	173	+
	174	+ def process_upload_msg(self, msg, stream, login, checkin=False):
	175	+ usr_cfg = Config(self.users_file)
	176	+ try:
	177	+ user_adj = login in usr_cfg["auth.adjudicators"].split()
	178	+ except KeyError:
	179	+ user_adj = False
	180	+
	181	+ db = Database(self.wc.db_path(), self.anno_per_file)
	182	+ n = msg.get_number()
	183	+ for _ in range(n):
	184	+ file_id = accept_msg(stream, Message).get_contents()
	185	+ is_adj = accept_msg(stream, BoolMessage).get_boolean()
	186	+ if is_adj and not user_adj:
	187	+ write_msg(stream, KoMessage())
	188	+ print >> self.log, "Upload error - user " + login + " tried to upload super annotated file " + file_id + " but is not a super annotator"
	189	+ continue
	190	+ else:
	191	+ error = db.upload_prevention(file_id, login, is_adj)
	192	+ if error is not None:
	193	+ write_msg(stream, KoMessage())
	194	+ print >> self.log, "Upload error by user " + login + ". Details: "+error
	195	+ continue
	196	+
	197	+ write_msg(stream, OkMessage())
	198	+ contents = receive_contents(stream)
	199	+ for key in contents.keys():
	200	+ if key not in self.file_exts:
	201	+ print >> self.log, "Skipped file uploaded by user " + login + ". Filename:"+file_id+key
	202	+ del contents[key]
	203	+
	204	+ if is_adj is False:
	205	+ if checkin:
	206	+ idx = db.upload(file_id, login)
	207	+ else:
	208	+ idx = db.upload_id(file_id, login)
	209	+ self.wc.upload(file_id, idx, contents)
	210	+ else:
	211	+ if checkin:
	212	+ db.upload_prim(file_id, login)
	213	+ self.wc.upload_prim(file_id, contents)
	214	+
	215	+ if checkin:
	216	+ db.save()
	217	+ accept_msg(stream, ClientDone)
	218	+ self.wc.commit("%s request from %s"
	219	+ % ("checkin" if checkin else "upload", login))
	220	+ write_msg(stream, ServerDone())
	221	+
	222	+ def process_checkout_msg(self, msg, stream, login):
	223	+ db = Database(self.wc.db_path(), self.anno_per_file)
	224	+
	225	+ ann_files = db.owns_normal(login)
	226	+ write_msg(stream, NumMessage(len(ann_files)))
	227	+ for file_id in ann_files:
	228	+ write_msg(stream, Message(file_id))
	229	+ idx = db.upload_id(file_id, login)
	230	+ contents = self.wc.checkout(file_id, idx, self.file_exts)
	231	+ send_contents(stream, contents)
	232	+
	233	+ adj_files = db.owns_super(login)
	234	+ write_msg(stream, NumMessage(len(adj_files)))
	235	+ write_msg(stream, NumMessage(self.anno_per_file))
	236	+ for file_id in adj_files:
	237	+ write_msg(stream, Message(file_id))
	238	+
	239	+ contents = self.wc.download_prim(file_id, self.file_exts, self.anno_per_file)
	240	+ for conts in contents:
	241	+ send_contents(stream, conts)
	242	+
	243	+ conts3 = self.wc.checkout_prim(file_id, self.file_exts)
	244	+ if conts3 is None:
	245	+ write_msg(stream, BoolMessage(False))
	246	+ else:
	247	+ write_msg(stream, BoolMessage(True))
	248	+ send_contents(stream, conts3)
	249	+
	250	+ accept_msg(stream, ClientDone)
	251	+ #self.wc.commit("checkout request from %s" % login)
	252	+ write_msg(stream, ServerDone())
	253	+
	254	+ def process_stats_msg(self, msg, stream, login):
	255	+ usr_cfg = Config(self.users_file)
	256	+ db = Database(self.wc.db_path(), self.anno_per_file)
	257	+
	258	+ write_msg(stream, NumMessage(db.finished_count(login)))
	259	+
	260	+ accept_msg(stream, ClientDone)
	261	+ write_msg(stream, ServerDone())
	262	+
	263	+ def process_download_msg(self, msg, stream, login):
	264	+ usr_cfg = Config(self.users_file)
	265	+ db = Database(self.wc.db_path(), self.anno_per_file)
	266	+
	267	+ down_num = msg.get_number()
	268	+ owns_num = len(db.owns_normal(login))
	269	+ limit = float('inf')
	270	+ try:
	271	+ limit = int(usr_cfg["limits.%s.annotation" % login])
	272	+ except KeyError:
	273	+ limit = int(usr_cfg["limits.annotation"])
	274	+ if down_num + owns_num > limit:
	275	+ down_num = max(0, limit - owns_num)
	276	+
	277	+ for_ann_fixed, for_ann = db.for_annotation(login)
	278	+ if len(for_ann) + len(for_ann_fixed) == 0:
	279	+ print >> self.log, "User " + login + " has no more files to download for annotation."
	280	+
	281	+ down_files = sample(for_ann_fixed, down_num)
	282	+ down_num = max(0, down_num - len(down_files))
	283	+ down_files = down_files + sample(for_ann, down_num)
	284	+
	285	+ write_msg(stream, NumMessage(len(down_files)))
	286	+
	287	+ for file_id in down_files:
	288	+ fixed_idx = db.download(file_id, login)
	289	+ write_msg(stream, Message(file_id))
	290	+ if fixed_idx is None:
	291	+ contents = self.wc.download(file_id, self.file_exts)
	292	+ else:
	293	+ contents = self.wc.checkout(file_id, fixed_idx, self.file_exts)
	294	+ send_contents(stream, contents)
	295	+ db.save()
	296	+ accept_msg(stream, ClientDone)
	297	+ self.wc.commit("download request from %s" % login)
	298	+ write_msg(stream, ServerDone())
	299	+
	300	+ def process_download_prim_msg(self, msg, stream, login):
	301	+ usr_cfg = Config(self.users_file)
	302	+ try:
	303	+ adjudicators = usr_cfg["auth.adjudicators"].split()
	304	+ except KeyError:
	305	+ adjudicators = []
	306	+ if login in adjudicators:
	307	+ write_msg(stream, OkMessage())
	308	+ else:
	309	+ write_msg(stream, KoMessage())
	310	+ return
	311	+ db = Database(self.wc.db_path(), self.anno_per_file)
	312	+
	313	+ down_num = msg.get_number()
	314	+ owns_num = len(db.owns_super(login))
	315	+ limit = float('inf')
	316	+ try:
	317	+ limit = int(usr_cfg["limits.%s.adjudication" % login])
	318	+ except KeyError:
	319	+ limit = int(usr_cfg["limits.adjudication"])
	320	+ if down_num + owns_num > limit:
	321	+ down_num = max(0, limit - owns_num)
	322	+
	323	+ for_adj_fixed, for_adj = db.for_adjudication(login)
	324	+ if len(for_adj) + len(for_adj_fixed) == 0:
	325	+ print >> self.log, "User " + login + " has no more files to download for superannotation."
	326	+
	327	+ down_files = sample(for_adj_fixed, down_num)
	328	+ down_num = max(0, down_num - len(down_files))
	329	+ down_files = down_files + sample(for_adj, down_num)
	330	+
	331	+ write_msg(stream, NumMessage(len(down_files)))
	332	+ write_msg(stream, NumMessage(self.anno_per_file))
	333	+ for file_id in down_files:
	334	+ write_msg(stream, Message(file_id))
	335	+ fixed = db.download_prim(file_id, login)
	336	+
	337	+ contents = self.wc.download_prim(file_id, self.file_exts, self.anno_per_file)
	338	+ for conts in contents:
	339	+ send_contents(stream, conts)
	340	+
	341	+ if fixed:
	342	+ write_msg(stream, BoolMessage(True))
	343	+ contents = self.wc.checkout_prim(file_id, self.file_exts)
	344	+ send_contents(stream, contents)
	345	+ else:
	346	+ write_msg(stream, BoolMessage(False))
	347	+
	348	+ db.save()
	349	+ accept_msg(stream, ClientDone)
	350	+ self.wc.commit("download' request from %s" % login)
	351	+ write_msg(stream, ServerDone())
	352	+
	353	+ def serve_client(self, connstream, login):
	354	+ msg = read_msg(connstream)
	355	+ try:
	356	+ self.process_msg(msg, connstream, login)
	357	+ except:
	358	+ self.wc.revert()
	359	+ raise
	360	+
	361	+def bind_socket(host, port, backlog=5):
	362	+ bound = socket.socket()
	363	+ bound.bind((host, port))
	364	+ bound.listen(backlog)
	365	+ return bound
	366	+
	367	+def sample(population, n):
	368	+ if len(population) > n:
	369	+ return random.sample(population, n)
	370	+ else:
	371	+ return population
	372	+
	373	+if __name__ == "__main__":
	374	+ optparser = OptionParser(usage="""usage: %prog CONFIG""")
	375	+ (options, args) = optparser.parse_args()
	376	+ if len(args) != 1:
	377	+ optparser.print_help()
	378	+ sys.exit(0)
	379	+
	380	+ cfg = Config(args[0])
	381	+ server = SSLServer(
	382	+ host=cfg["connection.host"],
	383	+ port=int(cfg["connection.port"]),
	384	+ backlog=int(cfg["connection.backlog"]),
	385	+ cert_file=cfg["connection.certfile"],
	386	+ key_file=cfg["connection.keyfile"],
	387	+ repository=cfg["svn.repository"],
	388	+ svn_login=cfg["svn.login"],
	389	+ svn_passwd=cfg["svn.passwd"],
	390	+ pass_file=cfg["users.passfile"],
	391	+ users_file=cfg["users.config"],
	392	+ file_exts=cfg["file_extensions"].split(),
	393	+ anno_per_file=int(cfg["anno_per_file"])
	394	+ )
	395	+
	396	+ def handler(signum, frame):
	397	+ server.exit()
	398	+
	399	+ signal.signal(signal.SIGINT, handler)
	400	+
	401	+ server.run()
...	...

dfs/utils.py 0 → 100644

View file @44cbbee

	1	+++ a/dfs/utils.py
	1	+# -- coding: utf-8 --
	2	+import hashlib
	3	+
	4	+from msg.stream import accept_msg, write_msg
	5	+from msg.message import Message, OkMessage, KoMessage, NumMessage
	6	+
	7	+class UserInvalid(Exception):
	8	+ pass
	9	+
	10	+def validate_user(conns, pass_file):
	11	+ pass_dict = parse_passwd(pass_file)
	12	+ login = accept_msg(conns, Message).get_contents()
	13	+ passwd = accept_msg(conns, Message).get_contents()
	14	+ if pass_dict.has_key(login) and pass_dict[login] == passwd:
	15	+ write_msg(conns, OkMessage())
	16	+ return login
	17	+ else:
	18	+ write_msg(conns, KoMessage())
	19	+ raise UserInvalid(login)
	20	+
	21	+def parse_passwd(pass_file):
	22	+ result = {}
	23	+ with open(pass_file) as f:
	24	+ for line in f:
	25	+ login, passwd = line.split("=")
	26	+ login = login.strip()
	27	+ passwd = passwd.strip()
	28	+ result[login] = passwd
	29	+ return result
	30	+
	31	+def _check_sum(*args):
	32	+ m = hashlib.sha256()
	33	+ for arg in args:
	34	+ m.update(arg)
	35	+ return m
	36	+
	37	+def check_sum(*args):
	38	+ return _check_sum(*args).digest()
	39	+
	40	+def check_hexsum(*args):
	41	+ return _check_sum(*args).hexdigest()
	42	+
	43	+def send_contents(stream, contents):
	44	+ write_msg(stream, NumMessage(len(contents)))
	45	+ for ext, data in contents.iteritems():
	46	+ write_msg(stream, Message(ext))
	47	+ write_msg(stream, Message(data))
	48	+ write_msg(stream, Message(check_sum(ext, data)))
	49	+ accept_msg(stream, OkMessage)
	50	+
	51	+def receive_contents(stream):
	52	+ contents = {}
	53	+ n = accept_msg(stream, NumMessage).get_number()
	54	+ for _ in range(n):
	55	+ ext = accept_msg(stream, Message).get_contents()
	56	+ data = accept_msg(stream, Message).get_contents()
	57	+ csum = accept_msg(stream, Message).get_contents()
	58	+ if csum == check_sum(ext, data):
	59	+ write_msg(stream, OkMessage())
	60	+ else:
	61	+ write_msg(stream, KoMessage())
	62	+ contents[ext] = data
	63	+ return contents
...	...

example_configuration/passwd 0 → 100644

View file @44cbbee

	1	+++ a/example_configuration/passwd
	1	+adj1 = adj1
	2	+adj2 = adj2
	3	+ann1 = ann1
	4	+ann2 = ann2
	5	+ann3 = ann3
	6	+ann4 = ann4
...	...

example_configuration/server.cfg 0 → 100644

View file @44cbbee

	1	+++ a/example_configuration/server.cfg
	1	+file_extensions = .mmax _words.xml _mentions.xml
	2	+anno_per_file = 2
	3	+
	4	+[connection]
	5	+host = localhost
	6	+port = 2225
	7	+backlog = 5 # maximum number of waiting connections
	8	+{paths} # paths relative to configuration file
	9	+certfile = ssl.conf/cert.pem
	10	+keyfile = ssl.conf/key.pem
	11	+
	12	+
	13	+[svn]
	14	+login = machine
	15	+passwd = asdasdT7
	16	+{paths}
	17	+repository = ../data/repo_wc # path to working copy of repo
	18	+
	19	+
	20	+[users]
	21	+{paths}
	22	+config = users.cfg
	23	+passfile = passwd
...	...

example_configuration/ssl.conf/cert.pem 0 → 100644

View file @44cbbee

	1	+++ a/example_configuration/ssl.conf/cert.pem
	1	+-----BEGIN CERTIFICATE-----
	2	+MIICkDCCAfmgAwIBAgIJAJPcESSEV86nMA0GCSqGSIb3DQEBBQUAMGExCzAJBgNV
	3	+BAYTAlBMMQ0wCwYDVQQIDARUZXN0MQ0wCwYDVQQHDARDaXR5MRAwDgYDVQQKDAdD
	4	+b21wYW55MSIwIAYJKoZIhvcNAQkBFhNleGFtcGxlQGV4YW1wbGUuY29tMB4XDTEz
	5	+MDEyMzEyMjIwN1oXDTE0MDEyMzEyMjIwN1owYTELMAkGA1UEBhMCUEwxDTALBgNV
	6	+BAgMBFRlc3QxDTALBgNVBAcMBENpdHkxEDAOBgNVBAoMB0NvbXBhbnkxIjAgBgkq
	7	+hkiG9w0BCQEWE2V4YW1wbGVAZXhhbXBsZS5jb20wgZ8wDQYJKoZIhvcNAQEBBQAD
	8	+gY0AMIGJAoGBAKUG9QHjUiCSjcvFQl1OqUgZ8c4Vzm7m7Ua7D33YDnGo3QGuhPML
	9	+0JB+JPBG++MrPdQqMV8eeXe1dFlrm6SHnrEZIhwZg8iDnPhFKNjHiAkx0PCQdI93
	10	+rAe4EcszkgbQCXXLGjQJNDikwGZ6ciylJ7C2XewWTlWjv7/LqMwhQotLAgMBAAGj
	11	+UDBOMB0GA1UdDgQWBBRLRvOFIo9LIeiT2ohQalEzy687ijAfBgNVHSMEGDAWgBRL
	12	+RvOFIo9LIeiT2ohQalEzy687ijAMBgNVHRMEBTADAQH/MA0GCSqGSIb3DQEBBQUA
	13	+A4GBAD1odtgH1kZ4a0TEbwjK2PaHTYyofkkgeXsGGnG3eMkwKQ7PHJarBl7GtxP5
	14	+Ls91k/KvBuNqCM/lPmM94USDSXrKGe0Zzc9WZbDG9SXO23gGOwPl+Tg9v1ocRHd2
	15	+dYYIgZM8/tLcsHyNNMd7c4BOMD4rzkjgbThFFMl/2NSkvrO7
	16	+-----END CERTIFICATE-----
...	...

example_configuration/ssl.conf/key.pem 0 → 100644

View file @44cbbee

	1	+++ a/example_configuration/ssl.conf/key.pem
	1	+-----BEGIN PRIVATE KEY-----
	2	+MIICeAIBADANBgkqhkiG9w0BAQEFAASCAmIwggJeAgEAAoGBAKUG9QHjUiCSjcvF
	3	+Ql1OqUgZ8c4Vzm7m7Ua7D33YDnGo3QGuhPML0JB+JPBG++MrPdQqMV8eeXe1dFlr
	4	+m6SHnrEZIhwZg8iDnPhFKNjHiAkx0PCQdI93rAe4EcszkgbQCXXLGjQJNDikwGZ6
	5	+ciylJ7C2XewWTlWjv7/LqMwhQotLAgMBAAECgYEAjx9XggmqgoFX5K/xfIbqHZQS
	6	+uE8FN/2jL0Kwjs3AySZQdlLrDvbiLU6ZrqGBd2VbPBRTuVDuu7ltbNf8plbQcxaa
	7	+yaKfKHPRYYIh/EqdaqsZ2bHHEARi03iNLDnktYz49I0ebFqgz0BGZVR3xDsjCu40
	8	+s9Tku7IQsDdO/zVvreECQQDXHW1vli7iuOmTYfwKqeIV7wFPj0vp8XrUVOKqjiG1
	9	+Fdf2ZlLrzeR/HbPbd2SL6u1dMV1j8wH/yPNRzFqNwOXpAkEAxGR5DzqrEE2ihyKL
	10	+WzQn6tTTA9FI8WPbgXdTm/R3dev2OgMLZycHlSgptCJ1f+fMfGNhWhotg8kZfrO0
	11	+9qnDEwJBAIpKrNQT5Mh0wBSz5WillmcrY9hV8yPOznw6pg2nmhvkkxYg6iYWE1N1
	12	+MO9ibg1VVouW9McQrrRV57cqfPysiiECQHP63d9Xh1R+dKAXj3LSD0zIWMGlY81i
	13	+amw/uvmb2ryiF+xUhfRqATld2ZsOypM5ofJHgmOCmCR+q3a+y/zrbk8CQQC0jx/T
	14	+TYw9ULoUe0bdx9RfJkrCEr7/+/DLs4MFwPiQ/e8foHcUL+CM9EY/FkMfbWbKjtuQ
	15	+iKXS/h5qp6NFdNVj
	16	+-----END PRIVATE KEY-----
...	...

example_configuration/users.cfg 0 → 100644

View file @44cbbee

	1	+++ a/example_configuration/users.cfg
	1	+[auth]
	2	+adjudicators = adj1 adj2
	3	+
	4	+[limits]
	5	+# number of files downloaded for annotation
	6	+annotation = 10
	7	+# number of file pairs download for adjudication
	8	+adjudication = 5
	9	+
	10	+# limits per user
	11	+# adj1.annotation = 2
	12	+# adj2.adjudication = 5
...	...

gui/CheckoutNumberDialog.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/CheckoutNumberDialog.py
	1	+# -- coding: utf-8 --
	2	+# generated by wxGlade 0.6.3 on Tue Sep 27 12:15:56 2011
	3	+
	4	+import wx
	5	+
	6	+# begin wxGlade: dependencies
	7	+# end wxGlade
	8	+
	9	+# begin wxGlade: extracode
	10	+
	11	+# end wxGlade
	12	+
	13	+"""aktualnie nieużywane! """
	14	+
	15	+class CheckoutNumberDialog(wx.Dialog):
	16	+ def __init__(self, args, *kwds):
	17	+ # begin wxGlade: CheckoutNumberDialog.__init__
	18	+ kwds["style"] = wx.DEFAULT_DIALOG_STYLE
	19	+ wx.Dialog.__init__(self, args, *kwds)
	20	+ self.label_4 = wx.StaticText(self, -1, "checkout files: ")
	21	+ self.checkout_number = wx.SpinCtrl(self, -1, "1", min=1, max=300)
	22	+ self.button_4 = wx.Button(self, wx.ID_YES, "OK")
	23	+ self.button_5 = wx.Button(self, wx.ID_NO, "Cancel")
	24	+
	25	+ self.__set_properties()
	26	+ self.__do_layout()
	27	+
	28	+ self.Bind(wx.EVT_BUTTON, self.on_ok, id=wx.ID_YES)
	29	+ self.Bind(wx.EVT_BUTTON, self.on_cancel, id=wx.ID_NO)
	30	+ # end wxGlade
	31	+
	32	+ def __set_properties(self):
	33	+ # begin wxGlade: CheckoutNumberDialog.__set_properties
	34	+ self.SetTitle("checkout")
	35	+ self.SetSize((193, 79))
	36	+ # end wxGlade
	37	+
	38	+ def __do_layout(self):
	39	+ # begin wxGlade: CheckoutNumberDialog.__do_layout
	40	+ sizer_8 = wx.BoxSizer(wx.VERTICAL)
	41	+ grid_sizer_3 = wx.GridSizer(1, 2, 0, 0)
	42	+ grid_sizer_2 = wx.GridSizer(1, 2, 0, 0)
	43	+ grid_sizer_2.Add(self.label_4, 0, wx.ALIGN_CENTER_VERTICAL, 0)
	44	+ grid_sizer_2.Add(self.checkout_number, 0, wx.ALIGN_CENTER_VERTICAL, 0)
	45	+ sizer_8.Add(grid_sizer_2, 1, 0, 0)
	46	+ grid_sizer_3.Add(self.button_4, 0, 0, 0)
	47	+ grid_sizer_3.Add(self.button_5, 0, 0, 0)
	48	+ sizer_8.Add(grid_sizer_3, 0, wx.BOTTOM, 0)
	49	+ self.SetSizer(sizer_8)
	50	+ self.Layout()
	51	+ self.Centre()
	52	+ # end wxGlade
	53	+
	54	+ def on_ok(self, event): # wxGlade: CheckoutNumberDialog.<event_handler>
	55	+ print "Event handler `on_ok' not implemented!"
	56	+ event.Skip()
	57	+
	58	+ def on_cancel(self, event): # wxGlade: CheckoutNumberDialog.<event_handler>
	59	+ print "Event handler `on_cancel' not implemented!"
	60	+ event.Skip()
	61	+
	62	+# end of class CheckoutNumberDialog
	63	+
	64	+
...	...

gui/ConfigDialog.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/ConfigDialog.py
	1	+# -- coding: utf-8 --
	2	+# generated by wxGlade 0.6.3 on Tue Sep 27 14:54:14 2011
	3	+
	4	+import wx
	5	+
	6	+import i18n
	7	+_ = i18n.language.ugettext #use ugettext instead of getttext to avoid unicode errors
	8	+
	9	+# begin wxGlade: dependencies
	10	+# end wxGlade
	11	+
	12	+# begin wxGlade: extracode
	13	+
	14	+# end wxGlade
	15	+
	16	+class ConfigDialog(wx.Dialog):
	17	+ def __init__(self, args, *kwds):
	18	+ # begin wxGlade: ConfigDialog.__init__
	19	+ kwds["style"] = wx.DEFAULT_DIALOG_STYLE
	20	+ wx.Dialog.__init__(self, args, *kwds)
	21	+ self.label_2 = wx.StaticText(self, -1, _("login")+":")
	22	+ self.login_ctrl = wx.TextCtrl(self, -1, "")
	23	+ self.label_6 = wx.StaticText(self, -1, _("password")+":")
	24	+ self.passwd_ctrl = wx.TextCtrl(self, -1, "", style=wx.TE_PASSWORD)
	25	+ self.label_5 = wx.StaticText(self, -1, _("extensions")+":")
	26	+ self.exts_ctrl = wx.TextCtrl(self, -1, "", size=(250,30))
	27	+ self.button_2 = wx.Button(self, wx.ID_OK, _("OK"))
	28	+
	29	+ self.__set_properties()
	30	+ self.__do_layout()
	31	+ # end wxGlade
	32	+
	33	+ def __set_properties(self):
	34	+ # begin wxGlade: ConfigDialog.__set_properties
	35	+ self.SetTitle(_("Directory configuration"))
	36	+ self.label_2.SetToolTipString(_("Login supplied by system administrator"))
	37	+ self.label_6.SetToolTipString(_("Password supplied by system administrator"))
	38	+ self.label_5.SetToolTipString(_("List of space separated file extensions"))
	39	+ self.button_2.SetMinSize((85, 29))
	40	+ self.button_2.SetFocus()
	41	+ # end wxGlade
	42	+
	43	+ def __do_layout(self):
	44	+ # begin wxGlade: ConfigDialog.__do_layout
	45	+ sizer_5 = wx.BoxSizer(wx.VERTICAL)
	46	+ grid_sizer_4 = wx.GridSizer(3, 2, 0, 0)
	47	+ grid_sizer_4.Add(self.label_2, 0, wx.ALIGN_CENTER_VERTICAL, 0)
	48	+ grid_sizer_4.Add(self.login_ctrl, 0, wx.ALIGN_CENTER_VERTICAL, 0)
	49	+ grid_sizer_4.Add(self.label_6, 0, wx.ALIGN_CENTER_VERTICAL, 0)
	50	+ grid_sizer_4.Add(self.passwd_ctrl, 0, wx.ALIGN_CENTER_VERTICAL, 0)
	51	+ grid_sizer_4.Add(self.label_5, 0, wx.ALIGN_CENTER_VERTICAL, 0)
	52	+ grid_sizer_4.Add(self.exts_ctrl, 0, wx.ALIGN_CENTER_VERTICAL, 0)
	53	+ sizer_5.Add(grid_sizer_4, 0, 0, 0)
	54	+ sizer_5.Add(self.button_2, 0, wx.ALIGN_CENTER_HORIZONTAL, 0)
	55	+ self.SetSizer(sizer_5)
	56	+ sizer_5.Fit(self)
	57	+ self.Layout()
	58	+ # end wxGlade
	59	+
	60	+# end of class ConfigDialog
	61	+
	62	+
...	...

gui/DownloadNumberDialog.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/DownloadNumberDialog.py
	1	+# -- coding: utf-8 --
	2	+# generated by wxGlade 0.6.3 on Wed Sep 28 10:10:39 2011
	3	+
	4	+import wx
	5	+
	6	+import i18n
	7	+_ = i18n.language.ugettext #use ugettext instead of getttext to avoid unicode errors
	8	+
	9	+# begin wxGlade: dependencies
	10	+# end wxGlade
	11	+
	12	+# begin wxGlade: extracode
	13	+
	14	+# end wxGlade
	15	+
	16	+class DownloadNumberDialog(wx.Dialog):
	17	+ def __init__(self, args, *kwds):
	18	+ # begin wxGlade: DownloadNumberDialog.__init__
	19	+ kwds["style"] = wx.DEFAULT_DIALOG_STYLE
	20	+ wx.Dialog.__init__(self, args, *kwds)
	21	+ self.label_4 = wx.StaticText(self, -1, _("Download count")+":")
	22	+ self.checkout_number = wx.SpinCtrl(self, -1, "1", min=1, max=300)
	23	+ self.button_4 = wx.Button(self, wx.ID_YES, _("OK"))
	24	+ self.button_5 = wx.Button(self, wx.ID_NO, _("Cancel"))
	25	+
	26	+ self.__set_properties()
	27	+ self.__do_layout()
	28	+
	29	+ self.Bind(wx.EVT_BUTTON, self.on_ok, id=wx.ID_YES)
	30	+ self.Bind(wx.EVT_BUTTON, self.on_cancel, id=wx.ID_NO)
	31	+ # end wxGlade
	32	+
	33	+ def __set_properties(self):
	34	+ # begin wxGlade: DownloadNumberDialog.__set_properties
	35	+ self.SetTitle(_("Download"))
	36	+ self.label_4.SetToolTipString(_("Number of files to download"))
	37	+ # end wxGlade
	38	+
	39	+ def __do_layout(self):
	40	+ # begin wxGlade: DownloadNumberDialog.__do_layout
	41	+ grid_sizer_2 = wx.GridSizer(2, 2, 20, 20)
	42	+ grid_sizer_2.Add(self.label_4, 0, wx.ALIGN_CENTER_HORIZONTAL\|wx.ALIGN_CENTER_VERTICAL, 0)
	43	+ grid_sizer_2.Add(self.checkout_number, 0, 0, 0)
	44	+ grid_sizer_2.Add(self.button_4, 0, wx.ALIGN_CENTER_HORIZONTAL\|wx.ALIGN_CENTER_VERTICAL, 0)
	45	+ grid_sizer_2.Add(self.button_5, 0, wx.ALIGN_CENTER_HORIZONTAL\|wx.ALIGN_CENTER_VERTICAL, 0)
	46	+ self.SetSizer(grid_sizer_2)
	47	+ grid_sizer_2.Fit(self)
	48	+ self.Layout()
	49	+ self.Centre()
	50	+ # end wxGlade
	51	+
	52	+ def on_ok(self, event): # wxGlade: DownloadNumberDialog.<event_handler>
	53	+ self.EndModal(wx.ID_OK)
	54	+
	55	+ def on_cancel(self, event): # wxGlade: DownloadNumberDialog.<event_handler>
	56	+ self.EndModal(wx.ID_CANCEL)
	57	+
	58	+# end of class DownloadNumberDialog
	59	+
	60	+
...	...

gui/LogDialog.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/LogDialog.py
	1	+# -- coding: utf-8 --
	2	+# generated by wxGlade 0.6.3 on Tue Sep 27 12:15:56 2011
	3	+
	4	+import wx
	5	+
	6	+# begin wxGlade: dependencies
	7	+# end wxGlade
	8	+
	9	+# begin wxGlade: extracode
	10	+
	11	+# end wxGlade
	12	+
	13	+"""aktualnie nieużywane! """
	14	+
	15	+class LogDialog(wx.Dialog):
	16	+ def __init__(self, args, *kwds):
	17	+ # begin wxGlade: LogDialog.__init__
	18	+ kwds["style"] = wx.DEFAULT_DIALOG_STYLE\|wx.RESIZE_BORDER\|wx.THICK_FRAME
	19	+ wx.Dialog.__init__(self, args, *kwds)
	20	+
	21	+ self.__set_properties()
	22	+ self.__do_layout()
	23	+ # end wxGlade
	24	+
	25	+ def __set_properties(self):
	26	+ # begin wxGlade: LogDialog.__set_properties
	27	+ self.SetTitle("Log")
	28	+ self.SetSize((400, 315))
	29	+ # end wxGlade
	30	+
	31	+ def __do_layout(self):
	32	+ # begin wxGlade: LogDialog.__do_layout
	33	+ self.Layout()
	34	+ # end wxGlade
	35	+
	36	+ def on_ok(self, event): # wxGlade: LogDialog.<event_handler>
	37	+ print "Event handler `on_ok' not implemented!"
	38	+ event.Skip()
	39	+
	40	+# end of class LogDialog
	41	+
	42	+
...	...

gui/LoginDialog.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/LoginDialog.py
	1	+# -- coding: utf-8 --
	2	+# generated by wxGlade 0.6.3 on Tue Sep 27 12:15:56 2011
	3	+
	4	+import wx
	5	+
	6	+# begin wxGlade: dependencies
	7	+# end wxGlade
	8	+
	9	+# begin wxGlade: extracode
	10	+
	11	+# end wxGlade
	12	+
	13	+"""aktualnie nieużywane! """
	14	+
	15	+class LoginDialog(wx.Dialog):
	16	+ def __init__(self, args, *kwds):
	17	+ # begin wxGlade: LoginDialog.__init__
	18	+ kwds["style"] = wx.DEFAULT_DIALOG_STYLE\|wx.RESIZE_BORDER\|wx.THICK_FRAME
	19	+ wx.Dialog.__init__(self, args, *kwds)
	20	+ self.label_1 = wx.StaticText(self, -1, "login: ")
	21	+ self.login_ctrl = wx.TextCtrl(self, -1, "")
	22	+ self.label_3 = wx.StaticText(self, -1, "password: ")
	23	+ self.passwd_ctrl = wx.TextCtrl(self, -1, "", style=wx.TE_PASSWORD)
	24	+ self.save_passwd = wx.CheckBox(self, -1, "save password")
	25	+ self.button_1 = wx.Button(self, wx.ID_OK, "OK")
	26	+
	27	+ self.__set_properties()
	28	+ self.__do_layout()
	29	+
	30	+ self.Bind(wx.EVT_BUTTON, self.on_ok, id=wx.ID_OK)
	31	+ # end wxGlade
	32	+
	33	+ def __set_properties(self):
	34	+ # begin wxGlade: LoginDialog.__set_properties
	35	+ self.SetTitle("login")
	36	+ self.button_1.SetMinSize((85, 32))
	37	+ # end wxGlade
	38	+
	39	+ def __do_layout(self):
	40	+ # begin wxGlade: LoginDialog.__do_layout
	41	+ sizer_4 = wx.BoxSizer(wx.VERTICAL)
	42	+ grid_sizer_1 = wx.GridSizer(2, 2, 0, 0)
	43	+ grid_sizer_1.Add(self.label_1, 0, wx.ALIGN_CENTER_VERTICAL, 0)
	44	+ grid_sizer_1.Add(self.login_ctrl, 0, 0, 0)
	45	+ grid_sizer_1.Add(self.label_3, 0, wx.ALIGN_CENTER_VERTICAL, 0)
	46	+ grid_sizer_1.Add(self.passwd_ctrl, 0, 0, 0)
	47	+ sizer_4.Add(grid_sizer_1, 0, 0, 0)
	48	+ sizer_4.Add(self.save_passwd, 0, 0, 0)
	49	+ sizer_4.Add(self.button_1, 0, wx.ALIGN_CENTER_HORIZONTAL, 0)
	50	+ self.SetSizer(sizer_4)
	51	+ sizer_4.Fit(self)
	52	+ self.Layout()
	53	+ # end wxGlade
	54	+
	55	+ def on_ok(self, event): # wxGlade: LoginDialog.<event_handler>
	56	+ print "Event handler `on_ok' not implemented!"
	57	+ event.Skip()
	58	+
	59	+# end of class LoginDialog
	60	+
	61	+
...	...

gui/MainFrame.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/MainFrame.py
	1	+# -- coding: utf-8 --
	2	+# generated by wxGlade 0.6.3 on Tue Sep 27 12:15:56 2011
	3	+
	4	+import wx
	5	+
	6	+import i18n
	7	+_ = i18n.language.ugettext
	8	+
	9	+from DownloadNumberDialog import DownloadNumberDialog
	10	+from ReturnReasonDialog import ReturnReasonDialog
	11	+from SortableListCtrl import SortableListCtrl
	12	+
	13	+import const
	14	+import utils
	15	+
	16	+# begin wxGlade: dependencies
	17	+# end wxGlade
	18	+
	19	+# begin wxGlade: extracode
	20	+
	21	+# end wxGlade
	22	+
	23	+class MainFrame(wx.Frame):
	24	+ def __init__(self, args, *kwds):
	25	+ # begin wxGlade: MainFrame.__init__
	26	+ kwds["style"] = wx.DEFAULT_FRAME_STYLE
	27	+ wx.Frame.__init__(self, args, *kwds)
	28	+ self.window_1 = wx.SplitterWindow(self, -1, style=wx.SP_3D\|wx.SP_BORDER)
	29	+ self.window_1_pane_2 = wx.Panel(self.window_1, -1)
	30	+ self.window_1_pane_1 = wx.Panel(self.window_1, -1)
	31	+ self.notebook_1 = wx.Notebook(self.window_1_pane_1, -1, style=wx.BK_DEFAULT)
	32	+ self.notebook_1_pane_1 = wx.Panel(self.notebook_1, -1)
	33	+ self.notebook_1_pane_2 = wx.Panel(self.notebook_1, -1)
	34	+
	35	+ self.log_ctrl = wx.TextCtrl(self.window_1_pane_2, -1, "", style=wx.TE_MULTILINE\|wx.TE_READONLY)
	36	+
	37	+ self.files_list = SortableListCtrl(self.notebook_1_pane_1, self.log_ctrl, False, const.program, const.extension)
	38	+ self.super_files_list = SortableListCtrl(self.notebook_1_pane_2, self.log_ctrl, True, const.program, const.extension)
	39	+
	40	+ # Menu Bar
	41	+ self.frame_1_menubar = wx.MenuBar()
	42	+ self.dir_menu = wx.Menu()
	43	+ self.dir_menu_open = wx.MenuItem(self.dir_menu, 5, _("Open"), _("Open new directory"), wx.ITEM_NORMAL)
	44	+ self.dir_menu.AppendItem(self.dir_menu_open)
	45	+ self.dir_menu.Append(6, _("Reconfigure"), _("Reconfigure directory"), wx.ITEM_NORMAL)
	46	+ self.dir_menu.AppendSeparator()
	47	+ if not const.hide_dir_menu == "yes":
	48	+ self.frame_1_menubar.Append(self.dir_menu, _("Directory"))
	49	+ wxglade_tmp_menu = wx.Menu()
	50	+ wxglade_tmp_menu.Append(1, _("Upload Selected"), _("Upload annotated or adjudicated files"), wx.ITEM_NORMAL)
	51	+ wxglade_tmp_menu.Append(8, _("Checkin Selected"), _("Upload annotated or adjudicated; files will be deleted from local disk and you will not be able to modify them again"), wx.ITEM_NORMAL)
	52	+ wxglade_tmp_menu.Append(10, _("Return Selected"), _("Return annotated or adjudicated because they are not suitable for annotation or contain errors"), wx.ITEM_NORMAL)
	53	+ wxglade_tmp_menu.AppendSeparator()
	54	+ wxglade_tmp_menu.Append(2, _("Download (annotation)"), _("Download files for annotation"), wx.ITEM_NORMAL)
	55	+ wxglade_tmp_menu.Append(3, _("Download (adjudication)"), _("Download files for adjudication"), wx.ITEM_NORMAL)
	56	+ wxglade_tmp_menu.AppendSeparator()
	57	+ wxglade_tmp_menu.Append(7, _("Checkout"), _("Checkout files from server to your local, empty directory"), wx.ITEM_NORMAL)
	58	+
	59	+ self.frame_1_menubar.Append(wxglade_tmp_menu, _("Files"))
	60	+ wxglade_tmp_menu = wx.Menu()
	61	+ wxglade_tmp_menu.Append(4, _("Ready"), _("Select items which are marked for upload"), wx.ITEM_NORMAL)
	62	+ wxglade_tmp_menu.Append(9, _("Modified"), _("Select items which are modified"), wx.ITEM_NORMAL)
	63	+ self.frame_1_menubar.Append(wxglade_tmp_menu, _("Select"))
	64	+
	65	+ wxglade_tmp_menu = wx.Menu()
	66	+ wxglade_tmp_menu.Append(11, _("Finished count"), _("Check number of finished texts"), wx.ITEM_NORMAL)
	67	+ self.frame_1_menubar.Append(wxglade_tmp_menu, _("Annotation"))
	68	+
	69	+ self.SetMenuBar(self.frame_1_menubar)
	70	+ # Menu Bar end
	71	+
	72	+ self.CreateStatusBar()
	73	+
	74	+ self.__set_properties()
	75	+ self.__do_layout()
	76	+
	77	+ self.Bind(wx.EVT_MENU, self.open_directory, self.dir_menu_open)
	78	+ self.Bind(wx.EVT_MENU, self.reconf_directory, id=6)
	79	+ self.Bind(wx.EVT_MENU, self.upload, id=1)
	80	+ self.Bind(wx.EVT_MENU, self.checkin, id=8)
	81	+ self.Bind(wx.EVT_MENU, self.download, id=2)
	82	+ self.Bind(wx.EVT_MENU, self.download_prim, id=3)
	83	+ self.Bind(wx.EVT_MENU, self.checkout, id=7)
	84	+ self.Bind(wx.EVT_MENU, self.select_ready, id=4)
	85	+ self.Bind(wx.EVT_MENU, self.select_modified, id=9)
	86	+ self.Bind(wx.EVT_MENU, self.return_files, id=10)
	87	+ self.Bind(wx.EVT_MENU, self.check_stats, id=11)
	88	+
	89	+ self.Bind(wx.EVT_LIST_ITEM_ACTIVATED, self.activate_item, self.files_list)
	90	+ self.Bind(wx.EVT_LIST_ITEM_ACTIVATED, self.activate_super_item, self.super_files_list)
	91	+
	92	+ def __set_properties(self):
	93	+ # begin wxGlade: MainFrame.__set_properties
	94	+ self.SetTitle("--")
	95	+ self.SetSize((663, 556))
	96	+ self.SetFocus()
	97	+ # end wxGlade
	98	+
	99	+ def __do_layout(self):
	100	+ # begin wxGlade: MainFrame.__do_layout
	101	+ sizer_6 = wx.BoxSizer(wx.HORIZONTAL)
	102	+ sizer_7 = wx.BoxSizer(wx.VERTICAL)
	103	+ sizer_1 = wx.BoxSizer(wx.VERTICAL)
	104	+ sizer_3 = wx.BoxSizer(wx.VERTICAL)
	105	+ sizer_2 = wx.BoxSizer(wx.VERTICAL)
	106	+ sizer_2.Add(self.files_list, 1, wx.EXPAND, 0)
	107	+ self.notebook_1_pane_1.SetSizer(sizer_2)
	108	+ sizer_3.Add(self.super_files_list, 1, wx.EXPAND, 0)
	109	+ self.notebook_1_pane_2.SetSizer(sizer_3)
	110	+ self.notebook_1.AddPage(self.notebook_1_pane_1, _("Annotation"))
	111	+ self.notebook_1.AddPage(self.notebook_1_pane_2, _("Adjudication"))
	112	+ sizer_1.Add(self.notebook_1, 1, wx.EXPAND, 0)
	113	+ self.window_1_pane_1.SetSizer(sizer_1)
	114	+ sizer_7.Add(self.log_ctrl, 1, wx.EXPAND, 0)
	115	+ self.window_1_pane_2.SetSizer(sizer_7)
	116	+ self.window_1.SplitHorizontally(self.window_1_pane_1, self.window_1_pane_2, -100)
	117	+ sizer_6.Add(self.window_1, 1, wx.EXPAND, 0)
	118	+ self.SetSizer(sizer_6)
	119	+ self.Layout()
	120	+ self.Centre()
	121	+ # end wxGlade
	122	+
	123	+ def set_manager(self, manager):
	124	+ self.manager = manager
	125	+
	126	+ def open_directory(self, event): # wxGlade: MainFrame.<event_handler>
	127	+ if event.GetId() == self.dir_menu_open.GetId():
	128	+ dlg = wx.DirDialog(self, message=_("Choose a directory"))
	129	+ try:
	130	+ if dlg.ShowModal() == wx.ID_OK:
	131	+ self.manager.set_directory(dlg.GetPath())
	132	+ finally:
	133	+ dlg.Destroy()
	134	+ else:
	135	+ item = self.dir_menu.FindItemById(event.GetId())
	136	+ self.manager.set_directory(item.GetLabel())
	137	+
	138	+ def upload(self, event): # wxGlade: MainFrame.<event_handler>
	139	+ names = ( self.files_list.get_selected()
	140	+ + self.super_files_list.get_selected() )
	141	+ info = ( _("Do you want to upload the following files?")+"\n\n"
	142	+ + "\n".join(names) )
	143	+ dial = wx.MessageDialog( self, info, _('Question')
	144	+ , wx.YES_NO \| wx.NO_DEFAULT \| wx.ICON_QUESTION )
	145	+ try:
	146	+ if dial.ShowModal() == wx.ID_YES:
	147	+ self.manager.upload(names, checkin=False)
	148	+ finally:
	149	+ dial.Destroy()
	150	+
	151	+ def return_files(self, event): # wxGlade: MainFrame.<event_handler>
	152	+ names = ( self.files_list.get_selected()
	153	+ + self.super_files_list.get_selected() )
	154	+ reason = None
	155	+ dialog = ReturnReasonDialog(self, names)
	156	+ try:
	157	+ if dialog.ShowModal() == wx.ID_OK:
	158	+ reason = dialog.reason.GetValue().encode("utf-8")
	159	+ finally:
	160	+ dialog.Destroy()
	161	+ if reason is not None:
	162	+ self.manager.return_files(names, reason)
	163	+
	164	+ def download(self, event): # wxGlade: MainFrame.<event_handler>
	165	+ num = None
	166	+ dialog = DownloadNumberDialog(self, -1)
	167	+ try:
	168	+ if dialog.ShowModal() == wx.ID_OK:
	169	+ num = dialog.checkout_number.GetValue()
	170	+ finally:
	171	+ dialog.Destroy()
	172	+ if num is not None:
	173	+ self.manager.download(num)
	174	+
	175	+ def download_prim(self, event): # wxGlade: MainFrame.<event_handler>
	176	+ num = None
	177	+ dialog = DownloadNumberDialog(self, -1)
	178	+ try:
	179	+ if dialog.ShowModal() == wx.ID_OK:
	180	+ num = dialog.checkout_number.GetValue()
	181	+ finally:
	182	+ dialog.Destroy()
	183	+ if num is not None:
	184	+ self.manager.download_prim(num)
	185	+
	186	+ def activate_item(self, event): # wxGlade: MainFrame.<event_handler>
	187	+ utils.change_ready( self.manager.ready
	188	+ , self.files_list
	189	+ , event.GetIndex() )
	190	+
	191	+ def activate_super_item(self, event): # wxGlade: MainFrame.<event_handler>
	192	+ utils.change_ready_prim( self.manager.ready
	193	+ , self.super_files_list
	194	+ , event.GetIndex() )
	195	+
	196	+ def reconf_directory(self, event): # wxGlade: MainFrame.<event_handler>
	197	+ self.manager.reconf_directory()
	198	+
	199	+ def select_ready(self, event): # wxGlade: MainFrame.<event_handler>
	200	+ self.files_list.select_ready()
	201	+ self.super_files_list.select_ready()
	202	+
	203	+ def checkout(self, event): # wxGlade: MainFrame.<event_handler>
	204	+ self.manager.checkout()
	205	+
	206	+ def checkin(self, event): # wxGlade: MainFrame.<event_handler>
	207	+ names = ( self.files_list.get_selected()
	208	+ + self.super_files_list.get_selected() )
	209	+ info = ( _("Do you want to checkin the following files?")+"\n\n"
	210	+ + "\n".join(names)
	211	+ + "\n\n"+_("Files will be deleted from the local directory and you will not be able to read, write or modify them later."))
	212	+ dial = wx.MessageDialog( self, info, _('Question')
	213	+ , wx.YES_NO \| wx.NO_DEFAULT \| wx.ICON_QUESTION )
	214	+ try:
	215	+ if dial.ShowModal() == wx.ID_YES:
	216	+ self.manager.upload(names, checkin=True)
	217	+ finally:
	218	+ dial.Destroy()
	219	+
	220	+ def select_modified(self, event): # wxGlade: MainFrame.<event_handler>
	221	+ self.files_list.select_modified()
	222	+ self.super_files_list.select_modified()
	223	+
	224	+ def check_stats(self, event): # wxGlade: MainFrame.<event_handler>
	225	+ self.manager.check_stats()
	226	+
	227	+# end of class MainFrame
...	...

gui/ReturnReasonDialog.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/ReturnReasonDialog.py
	1	+# -- coding: utf-8 --
	2	+# generated by wxGlade 0.6.3 on Wed Sep 28 10:10:39 2011
	3	+
	4	+import wx
	5	+
	6	+import i18n
	7	+_ = i18n.language.ugettext #use ugettext instead of getttext to avoid unicode errors
	8	+
	9	+# begin wxGlade: dependencies
	10	+# end wxGlade
	11	+
	12	+# begin wxGlade: extracode
	13	+
	14	+# end wxGlade
	15	+
	16	+class ReturnReasonDialog(wx.Dialog):
	17	+ def __init__(self, parent, names):
	18	+ # begin wxGlade: ReturnReasonDialog.__init__
	19	+ wx.Dialog.__init__(self, parent, -1)
	20	+
	21	+ info = ( _("Why do you want to return the following files?")+"\n"
	22	+ + "\n".join(names) )
	23	+
	24	+ self.label_1 = wx.StaticText(self, -1, info)
	25	+ self.label_4 = wx.StaticText(self, -1, _("Reason")+":")
	26	+ self.reason = wx.TextCtrl(self, -1, "", size=(250, 80), style=wx.TE_MULTILINE\|wx.TE_PROCESS_ENTER)
	27	+ self.button_4 = wx.Button(self, wx.ID_YES, _("OK"))
	28	+ self.button_5 = wx.Button(self, wx.ID_NO, _("Cancel"))
	29	+
	30	+ self.__set_properties()
	31	+ self.__do_layout()
	32	+
	33	+ self.Bind(wx.EVT_BUTTON, self.on_ok, id=wx.ID_YES)
	34	+ self.Bind(wx.EVT_BUTTON, self.on_cancel, id=wx.ID_NO)
	35	+ # end wxGlade
	36	+
	37	+ def __set_properties(self):
	38	+ # begin wxGlade: ReturnReasonDialog.__set_properties
	39	+ self.SetTitle(_("Return files"))
	40	+ # end wxGlade
	41	+
	42	+ def __do_layout(self):
	43	+ # begin wxGlade: ReturnReasonDialog.__do_layout
	44	+ sizer_2 = wx.BoxSizer(wx.HORIZONTAL)
	45	+ sizer_2.Add(self.label_4, 0, wx.ALIGN_CENTER_HORIZONTAL\|wx.ALIGN_CENTER_VERTICAL, 0)
	46	+ sizer_2.Add(self.reason, 0, 0, 0)
	47	+
	48	+ sizer_3 = wx.BoxSizer(wx.HORIZONTAL)
	49	+ sizer_3.Add(self.button_4, 0, wx.ALIGN_CENTER_HORIZONTAL\|wx.ALIGN_CENTER_VERTICAL, 0)
	50	+ sizer_3.Add(self.button_5, 0, wx.ALIGN_CENTER_HORIZONTAL\|wx.ALIGN_CENTER_VERTICAL, 0)
	51	+
	52	+ sizer_1 = wx.BoxSizer(wx.VERTICAL)
	53	+ sizer_1.Add(self.label_1, 0, wx.ALIGN_CENTER_HORIZONTAL\|wx.ALIGN_CENTER_VERTICAL, 1)
	54	+ sizer_1.Add(sizer_2, 0, wx.ALIGN_CENTER_HORIZONTAL\|wx.ALIGN_CENTER_VERTICAL, 1)
	55	+ sizer_1.Add(sizer_3, 0, wx.ALIGN_CENTER_HORIZONTAL\|wx.ALIGN_CENTER_VERTICAL, 1)
	56	+ self.SetSizer(sizer_1)
	57	+ sizer_1.Fit(self)
	58	+ self.Layout()
	59	+ # end wxGlade
	60	+
	61	+ def on_ok(self, event): # wxGlade: ReturnReasonDialog.<event_handler>
	62	+ self.EndModal(wx.ID_OK)
	63	+
	64	+ def on_cancel(self, event): # wxGlade: ReturnReasonDialog.<event_handler>
	65	+ self.EndModal(wx.ID_CANCEL)
	66	+
	67	+# end of class ReturnReasonDialog
	68	+
	69	+
...	...

gui/SortableListCtrl.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/SortableListCtrl.py
	1	+# -- coding: utf-8 --
	2	+import threading
	3	+from PIL import Image
	4	+
	5	+import i18n
	6	+_ = i18n.language.ugettext #use ugettext instead of getttext to avoid unicode errors
	7	+
	8	+import os.path
	9	+import wx
	10	+import wx.lib.mixins.listctrl as listmix
	11	+import subprocess
	12	+
	13	+try:
	14	+ from agw import ultimatelistctrl as ULC
	15	+except ImportError: # if it's not there locally, try the wxPython lib.
	16	+ from wx.lib.agw import ultimatelistctrl as ULC
	17	+
	18	+class SortableListCtrl(ULC.UltimateListCtrl, listmix.ColumnSorterMixin, listmix.ListCtrlAutoWidthMixin):
	19	+ def __init__(self, parent, log, superann, program, extension):
	20	+
	21	+ self._lock = threading.Lock()
	22	+
	23	+ self.program = program
	24	+ self.extension = extension
	25	+
	26	+ ULC.UltimateListCtrl.__init__(self, parent, -1, agwStyle=ULC.ULC_REPORT \| ULC.ULC_HAS_VARIABLE_ROW_HEIGHT \| ULC.ULC_USER_ROW_HEIGHT)#\| wx.LC_HRULES \| wx.LC_VRULES )
	27	+ listmix.ListCtrlAutoWidthMixin.__init__(self)
	28	+
	29	+ self.log_ctrl = log
	30	+
	31	+ self.il = wx.ImageList(16, 16)
	32	+ up = wx.Image(os.path.join('img', 'up.png'), wx.BITMAP_TYPE_PNG).ConvertToBitmap()
	33	+ down = wx.Image(os.path.join('img', 'down.png'), wx.BITMAP_TYPE_PNG).ConvertToBitmap()
	34	+ if superann:
	35	+ textimg_1 = wx.Image(os.path.join('img', 'textimg_2.png'), wx.BITMAP_TYPE_PNG).ConvertToBitmap()
	36	+ else:
	37	+ textimg_1 = wx.Image(os.path.join('img', 'textimg_1.png'), wx.BITMAP_TYPE_PNG).ConvertToBitmap()
	38	+ ready = wx.Image(os.path.join('img', 'ready.png'), wx.BITMAP_TYPE_PNG).ConvertToBitmap()
	39	+ self.sm_up = self.il.Add(up)
	40	+ self.sm_dn = self.il.Add(down)
	41	+ self.textimg_1 = self.il.Add(textimg_1)
	42	+ self.ready = self.il.Add(ready)
	43	+
	44	+ self.AssignImageList(self.il, wx.IMAGE_LIST_SMALL)
	45	+
	46	+ self.SetUserLineHeight(23)
	47	+ self.InsertColumn(0, _("File"))
	48	+ self.InsertColumn(1, _("Status"))
	49	+ self.InsertColumn(2, _("Ready"))
	50	+ self.InsertColumn(3, _("Stage"))
	51	+ self.InsertColumn(4, "")
	52	+ self.SetColumnWidth(0, 80)
	53	+ self.SetColumnWidth(1, 100)
	54	+ self.SetColumnWidth(2, 120)
	55	+ self.SetColumnWidth(3, 100)
	56	+
	57	+ self.itemDataMap = {}
	58	+
	59	+ listmix.ColumnSorterMixin.__init__(self, 5)
	60	+
	61	+ # required by ColumnSorterMixin
	62	+ def GetListCtrl(self):
	63	+ return self
	64	+
	65	+ def GetSortImages(self):
	66	+ return (self.sm_dn, self.sm_up)
	67	+ # required by ColumnSorterMixin - end
	68	+
	69	+ def show(self, data):
	70	+ self._lock.acquire()
	71	+ try:
	72	+ # for some reason deleteAllItems() doesn't work with buttons inside ulc
	73	+ for item in range(self.GetItemCount()):
	74	+ self.DeleteItem(0)
	75	+ self.itemDataMap.clear()
	76	+ for i, (file_name, status, is_ready, stage) in enumerate(data):
	77	+ img = self.textimg_1
	78	+ if is_ready == _("Yes"):
	79	+ img = self.ready
	80	+ pos = self.InsertImageStringItem(i, file_name, img)
	81	+ self.SetStringItem(pos, 1, status)
	82	+ self.SetStringItem(pos, 2, is_ready)
	83	+ self.SetStringItem(pos, 3, stage)
	84	+
	85	+ button = wx.Button(self, id=i, size=(80, 23), label=_("Open"))
	86	+ self.SetItemWindow(pos, col=4, wnd=button, expand=False)
	87	+ button.Bind(wx.EVT_BUTTON, self.open_button)
	88	+
	89	+ self.SetItemData(pos, i)
	90	+
	91	+ self.itemDataMap[i] = (file_name, status, is_ready, stage, None)
	92	+ finally:
	93	+ self._lock.release()
	94	+
	95	+ def shown_data(self):
	96	+ result = []
	97	+ for i in range(self.GetItemCount()):
	98	+ part_result = []
	99	+ for j in range(0, 4):
	100	+ part_result.append(self.GetItem(i, j).GetText())
	101	+ result.append(tuple(part_result))
	102	+ return result
	103	+
	104	+ def SetReadyYes(self, pos):
	105	+ self.SetItemImage(pos, self.ready)
	106	+ return self._set_ready(pos, _("Yes"))
	107	+
	108	+ def SetReadyNo(self, pos):
	109	+ self.SetItemImage(pos, self.textimg_1)
	110	+ return self._set_ready(pos, _("No"))
	111	+
	112	+ def _set_ready(self, pos, val):
	113	+ file_name = self.GetItem(pos, 0).GetText()
	114	+ for key, (filename, status, ready, stage, sth) in self.itemDataMap.iteritems():
	115	+ if filename == file_name:
	116	+ self.itemDataMap[key] = (filename, status, val, stage, sth)
	117	+ break
	118	+ return self.SetStringItem(pos, 2, val)
	119	+
	120	+ def GetFilename(self, pos):
	121	+ return self.GetItem(pos, 0).GetText()
	122	+
	123	+ def IsReady(self, pos):
	124	+ return self.GetItem(pos, 2).GetText() == _("Yes")
	125	+
	126	+ def select_ready(self):
	127	+ return self._select(lambda list, pos : list.GetItem(pos, 2).GetText() == _("Yes"))
	128	+
	129	+ def select_modified(self):
	130	+ return self._select(lambda list, pos : list.GetItem(pos, 1).GetText() == _("Modified"))
	131	+
	132	+ def _select(self, cond):
	133	+ for i in range(self.GetItemCount()):
	134	+ if cond(self, i):
	135	+ self.Select(i, 1)
	136	+ else:
	137	+ self.Select(i, 0)
	138	+
	139	+ def get_selected(self):
	140	+ fnames = []
	141	+ for i in range(self.GetItemCount()):
	142	+ if self.IsSelected(i):
	143	+ fnames.append(self.GetFilename(i))
	144	+ return fnames
	145	+
	146	+ def open_button(self, event):
	147	+ file_name = self.GetFilename(event.GetEventObject().GetId())
	148	+ print event.GetEventObject().GetId()
	149	+ if file_name:
	150	+ self.log_ctrl.AppendText(_("Starting ") + self.program + _(" for text") + " " + file_name + "...\n")
	151	+ app = os.path.join("..", self.program, self.program+".exe")
	152	+ app_bin = os.path.join("..", self.program, self.program)
	153	+ if not os.path.exists(app):
	154	+ app = app_bin
	155	+ text = os.path.join("..", "teksty", file_name + self.extension)
	156	+ try:
	157	+ subprocess.Popen([app, text])
	158	+ except Exception as ex:
	159	+ self.log_ctrl.AppendText(_("Error starting ") + self.program + ": " + unicode(str(ex), errors='replace') + "\n")
	160	+
...	...

gui/client.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/client.py
	1	+# -- coding: utf-8 --
	2	+import sys
	3	+import os
	4	+import shutil
	5	+import tempfile
	6	+import socket
	7	+import ssl
	8	+import pprint
	9	+from optparse import OptionParser
	10	+import traceback
	11	+import re
	12	+
	13	+import i18n
	14	+_ = i18n.language.ugettext
	15	+
	16	+from dfs.msg.stream import write_msg, read_msg, accept_msg
	17	+from dfs.msg.message import *
	18	+from dfs.utils import check_sum, send_contents, receive_contents
	19	+
	20	+from utils import normal_files, super_files
	21	+
	22	+def init_stream(host, port, cert, log=None):
	23	+ log_msg(_("Connecting server..."), log)
	24	+ s = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
	25	+ stream = ssl.wrap_socket(s, ca_certs=cert, cert_reqs=ssl.CERT_REQUIRED, ssl_version=ssl.PROTOCOL_TLSv1)
	26	+ stream.connect((host, port))
	27	+ return stream
	28	+
	29	+def upload(stream, files, src_dir, file_exts, checkin=False, log=None):
	30	+ """Checkin / Upload files to the server."""
	31	+
	32	+ def is_adj(path):
	33	+ return False if len(os.path.dirname(path)) == 0 else True
	34	+
	35	+ log_msg(_("Sending request..."), log)
	36	+ if checkin:
	37	+ write_msg(stream, CheckinRequest(len(files)))
	38	+ else:
	39	+ write_msg(stream, UploadRequest(len(files)))
	40	+ done = []
	41	+
	42	+ failed = set()
	43	+ for file_path in files:
	44	+ log_msg(_("Uploading") + " " + file_path + "...", log)
	45	+
	46	+ if not is_adj(file_path):
	47	+ file_id = file_path
	48	+ contents = read_contents(src_dir, file_path, file_exts)
	49	+ else:
	50	+ file_id, choice = os.path.split(file_path)
	51	+ contents = read_contents(os.path.join(src_dir, file_id), choice, file_exts)
	52	+
	53	+ write_msg(stream, Message(file_id))
	54	+ write_msg(stream, BoolMessage(is_adj(file_path)))
	55	+ msg = read_msg(stream)
	56	+ if type(msg) != OkMessage:
	57	+ log_msg(_("Upload failed: server doesn't accept this file from you"), log)
	58	+ failed.add(file_path)
	59	+ continue
	60	+ send_contents(stream, contents)
	61	+
	62	+ write_msg(stream, ClientDone())
	63	+ accept_msg(stream, ServerDone)
	64	+
	65	+ if not checkin:
	66	+ log_msg(_("Done"), log)
	67	+ return
	68	+
	69	+ # When checkin command
	70	+ for file_path in files:
	71	+ if file_path in failed:
	72	+ continue
	73	+ if not is_adj(file_path):
	74	+ log_msg(_("Deleting") + " " + file_path + "...", log)
	75	+ for ext in file_exts:
	76	+ os.remove(os.path.join(src_dir, file_path + ext))
	77	+ else:
	78	+ file_id, ver = os.path.split(file_path)
	79	+ log_msg(_("Deleting") + " " + file_id + "...", log)
	80	+ shutil.rmtree(os.path.join(src_dir, file_id))
	81	+
	82	+ log_msg(_("Done"), log)
	83	+
	84	+def download(stream, n, dest_dir, tmp_dir, log=None):
	85	+ """Download from server n files."""
	86	+
	87	+ log_msg(_("Sending request..."), log)
	88	+ write_msg(stream, DownloadRequest(n))
	89	+ n = accept_msg(stream, NumMessage).get_number()
	90	+ if n == 0:
	91	+ log_msg(_("No files to download"), log)
	92	+
	93	+ done = []
	94	+ for i in range(n):
	95	+ file_id = accept_msg(stream, Message).get_contents()
	96	+ log_msg(_("Downloading") + " " + file_id + "...", log)
	97	+ contents = receive_contents(stream)
	98	+ save_contents(contents, tmp_dir, file_id)
	99	+ for ext in contents.keys():
	100	+ done.append(file_id + ext)
	101	+
	102	+ write_msg(stream, ClientDone())
	103	+ accept_msg(stream, ServerDone)
	104	+ for file_name in done:
	105	+ from_path = os.path.join(tmp_dir, file_name)
	106	+ to_path = os.path.join(dest_dir, file_name)
	107	+ shutil.move(from_path, to_path)
	108	+ log_msg(_("Done"), log)
	109	+
	110	+def download_prim(stream, n, dest_dir, tmp_dir, log=None):
	111	+ """Download from server n pairs of files for adjudication."""
	112	+
	113	+ log_msg(_("Sending request..."), log)
	114	+ write_msg(stream, DownloadPrimRequest(n))
	115	+
	116	+ msg = read_msg(stream)
	117	+ if type(msg) != OkMessage:
	118	+ log_msg(_("FAILED: you don't have adjudicator privileges"), log)
	119	+ return
	120	+
	121	+ n = accept_msg(stream, NumMessage).get_number()
	122	+ anno_per_file = accept_msg(stream, NumMessage).get_number()
	123	+ if n == 0:
	124	+ log_msg(_("No files to download"), log)
	125	+
	126	+ done = []
	127	+ for i in range(n):
	128	+ file_id = accept_msg(stream, Message).get_contents()
	129	+ log_msg(_("Downloading") + " " + file_id + "...", log)
	130	+
	131	+ file_dir = os.path.join(tmp_dir, file_id)
	132	+ os.mkdir(file_dir)
	133	+ done.append(file_id)
	134	+
	135	+ for j in range(anno_per_file):
	136	+ save_contents(receive_contents(stream), file_dir, chr(ord('A') + j))
	137	+
	138	+ if accept_msg(stream, BoolMessage).get_boolean() == True:
	139	+ if anno_per_file == 1:
	140	+ save_contents(receive_contents(stream), file_dir, "A")
	141	+ else:
	142	+ save_contents(receive_contents(stream), file_dir, "Super")
	143	+
	144	+ write_msg(stream, ClientDone())
	145	+ accept_msg(stream, ServerDone)
	146	+ for fild_id in done:
	147	+ from_path = os.path.join(tmp_dir, fild_id)
	148	+ to_path = os.path.join(dest_dir, fild_id)
	149	+ shutil.move(from_path, to_path)
	150	+ log_msg(_("Done"), log)
	151	+
	152	+def check_stats(stream, log=None):
	153	+ """Check annotatator stats."""
	154	+
	155	+ log_msg(_("Sending request..."), log)
	156	+ write_msg(stream, StatsRequest())
	157	+ n = accept_msg(stream, NumMessage).get_number()
	158	+ log_msg(_("Number of finished files: ") + str(n), log)
	159	+ write_msg(stream, ClientDone())
	160	+ accept_msg(stream, ServerDone)
	161	+ log_msg(_("Done"), log)
	162	+
	163	+def checkout(stream, dest_dir, tmp_dir, exts, log=None):
	164	+ log_msg(_("Sending request..."), log)
	165	+ write_msg(stream, CheckoutRequest())
	166	+
	167	+ done = []
	168	+ n = accept_msg(stream, NumMessage).get_number()
	169	+ for i in range(n):
	170	+ file_id = accept_msg(stream, Message).get_contents()
	171	+ log_msg(_("Downloading") + " " + file_id + "...", log)
	172	+
	173	+ contents = receive_contents(stream)
	174	+ save_contents(contents, tmp_dir, file_id)
	175	+ for ext in contents.keys():
	176	+ done.append(file_id + ext)
	177	+
	178	+ n = accept_msg(stream, NumMessage).get_number()
	179	+ anno_per_file = accept_msg(stream, NumMessage).get_number()
	180	+
	181	+ for i in range(n):
	182	+ file_id = accept_msg(stream, Message).get_contents()
	183	+ log_msg(_("Downloading") + " " + file_id + "...", log)
	184	+
	185	+ file_dir = os.path.join(tmp_dir, file_id)
	186	+ os.mkdir(file_dir)
	187	+
	188	+ for j in range(anno_per_file):
	189	+ save_contents(receive_contents(stream), file_dir, chr(j + ord('A')))
	190	+
	191	+ if accept_msg(stream, BoolMessage).get_boolean() == True:
	192	+ if anno_per_file == 1:
	193	+ save_contents(receive_contents(stream), file_dir, "A")
	194	+ else:
	195	+ save_contents(receive_contents(stream), file_dir, "Super")
	196	+
	197	+ done.append(file_id)
	198	+
	199	+ write_msg(stream, ClientDone())
	200	+ accept_msg(stream, ServerDone)
	201	+
	202	+ log_msg(_("Deleting local files..."), log)
	203	+ try:
	204	+ # normal texts
	205	+ for f in normal_files(dest_dir, exts):
	206	+ for ext in exts:
	207	+ os.remove(os.path.join(dest_dir, f + ext))
	208	+
	209	+ # super annotated texts
	210	+ dirs = set()
	211	+ for f in super_files(dest_dir, exts):
	212	+ dir = f.split(os.path.sep)[0]
	213	+ dirs.add(dir)
	214	+ for dir in dirs:
	215	+ shutil.rmtree(os.path.join(dest_dir, dir))
	216	+
	217	+ except Exception as ex:
	218	+ log_msg(_("Error occured:") + unicode(str(ex), errors='replace'), log)
	219	+
	220	+ log_msg(_("Saving dowloaded files..."), log)
	221	+ for path in done:
	222	+ from_path = os.path.join(tmp_dir, path)
	223	+ to_path = os.path.join(dest_dir, path)
	224	+ shutil.move(from_path, to_path)
	225	+
	226	+ log_msg(_("Done"), log)
	227	+
	228	+def return_files(stream, files, reason, src_dir, file_exts, log=None):
	229	+ """Return files to the server."""
	230	+
	231	+ def is_adj(path):
	232	+ return False if len(os.path.dirname(path)) == 0 else True
	233	+
	234	+ log_msg(_("Sending request..."), log)
	235	+ write_msg(stream, ReturnRequest(len(files)))
	236	+ write_msg(stream, Message(reason))
	237	+
	238	+ done = []
	239	+
	240	+ failed = set()
	241	+ for file_path in files:
	242	+ log_msg(_("Uploading") + " " + file_path + "...", log)
	243	+
	244	+ if not is_adj(file_path):
	245	+ file_id = file_path
	246	+ contents = read_contents(src_dir, file_path, file_exts)
	247	+ else:
	248	+ file_id, choice = os.path.split(file_path)
	249	+ contents = read_contents(os.path.join(src_dir, file_id), choice, file_exts)
	250	+
	251	+ write_msg(stream, Message(file_id))
	252	+ write_msg(stream, BoolMessage(is_adj(file_path)))
	253	+ msg = read_msg(stream)
	254	+ if type(msg) != OkMessage:
	255	+ log_msg(_("Upload failed: server doesn't accept this file from you"), log)
	256	+ failed.add(file_path)
	257	+ continue
	258	+ send_contents(stream, contents)
	259	+
	260	+ write_msg(stream, ClientDone())
	261	+ accept_msg(stream, ServerDone)
	262	+
	263	+ for file_path in files:
	264	+ if file_path in failed:
	265	+ continue
	266	+ if not is_adj(file_path):
	267	+ log_msg(_("Deleting") + " " + file_path + "...", log)
	268	+ for ext in file_exts:
	269	+ os.remove(os.path.join(src_dir, file_path + ext))
	270	+ else:
	271	+ file_id, ver = os.path.split(file_path)
	272	+ log_msg(_("Deleting") + " " + file_id + "...", log)
	273	+ shutil.rmtree(os.path.join(src_dir, file_id))
	274	+
	275	+ log_msg(_("Done"), log)
	276	+
	277	+def save_contents(contents, dest_dir, file_id):
	278	+ for ext, data in contents.iteritems():
	279	+ dest_path = os.path.join(dest_dir, file_id + ext)
	280	+ with open(dest_path, "w") as dest:
	281	+ dest.write(data)
	282	+
	283	+def read_contents(src_dir, file_id, file_exts):
	284	+ result = {}
	285	+ regex = re.compile("%s(.*)$" % file_id)
	286	+ for entry in os.listdir(src_dir):
	287	+ match = regex.match(entry)
	288	+ if not match:
	289	+ continue
	290	+ with open(os.path.join(src_dir, entry)) as src:
	291	+ ext = match.group(1)
	292	+ if ext in file_exts:
	293	+ result[ext] = src.read()
	294	+ else:
	295	+ print "Skipping file " + entry
	296	+ return result
	297	+
	298	+def run_auth(stream, login, passwd, log=None):
	299	+ log_msg(_("Authentication..."), log)
	300	+ write_msg(stream, Message(login))
	301	+ write_msg(stream, Message(passwd))
	302	+ msg = read_msg(stream)
	303	+ if type(msg) != OkMessage:
	304	+ log_msg(_("FAILED: incorrect login or password"), log)
	305	+ return False
	306	+ return True
	307	+
	308	+def run_upload(login, passwd, host, port, cert, files, src_dir, file_exts, checkin=False, log=None):
	309	+ result = True
	310	+ try:
	311	+ stream = init_stream(host, port, cert, log=log)
	312	+ try:
	313	+ if run_auth(stream, login, passwd, log=log):
	314	+ upload(stream, files, src_dir, file_exts, checkin=checkin, log=log)
	315	+ finally:
	316	+ stream.close()
	317	+ except:
	318	+ log_msg(_("FAILED: unable to connect to server"), log)
	319	+ print traceback.format_exc()
	320	+ result = False
	321	+ if log:
	322	+ log.put(None)
	323	+ return result
	324	+
	325	+def run_download(login, passwd, host, port, cert, n, dest_dir, log=None):
	326	+ result = True
	327	+ try:
	328	+ stream = init_stream(host, port, cert, log=log)
	329	+ try:
	330	+ tmp_dir = tempfile.mkdtemp()
	331	+ try:
	332	+ if run_auth(stream, login, passwd, log=log):
	333	+ download(stream, n, dest_dir, tmp_dir, log=log)
	334	+ finally:
	335	+ shutil.rmtree(tmp_dir)
	336	+ finally:
	337	+ stream.close()
	338	+ except:
	339	+ log_msg(_("FAILED: unable to connect to server"), log)
	340	+ print traceback.format_exc()
	341	+ result = False
	342	+ if log:
	343	+ log.put(None)
	344	+ return result
	345	+
	346	+def run_check_stats(login, passwd, host, port, cert, log=None):
	347	+ result = True
	348	+ try:
	349	+ stream = init_stream(host, port, cert, log=log)
	350	+ try:
	351	+ if run_auth(stream, login, passwd, log=log):
	352	+ check_stats(stream, log=log)
	353	+ finally:
	354	+ stream.close()
	355	+ except:
	356	+ log_msg(_("FAILED: unable to connect to server"), log)
	357	+ print traceback.format_exc()
	358	+ result = False
	359	+ if log:
	360	+ log.put(None)
	361	+ return result
	362	+
	363	+def run_download_prim(login, passwd, host, port, cert, n, dest_dir, log=None):
	364	+ result = True
	365	+ try:
	366	+ stream = init_stream(host, port, cert, log=log)
	367	+ try:
	368	+ tmp_dir = tempfile.mkdtemp()
	369	+ try:
	370	+ if run_auth(stream, login, passwd, log=log):
	371	+ download_prim(stream, n, dest_dir, tmp_dir, log=log)
	372	+ finally:
	373	+ shutil.rmtree(tmp_dir)
	374	+ finally:
	375	+ stream.close()
	376	+ except:
	377	+ log_msg(_("FAILED: unable to connect to server"), log)
	378	+ print traceback.format_exc()
	379	+ result = False
	380	+ if log:
	381	+ log.put(None)
	382	+ return result
	383	+
	384	+def run_checkout(login, passwd, host, port, cert, dest_dir, exts, log=None):
	385	+ result = True
	386	+ try:
	387	+ stream = init_stream(host, port, cert, log=log)
	388	+ try:
	389	+ tmp_dir = tempfile.mkdtemp()
	390	+ try:
	391	+ if run_auth(stream, login, passwd, log=log):
	392	+ checkout(stream, dest_dir, tmp_dir, exts, log=log)
	393	+ finally:
	394	+ shutil.rmtree(tmp_dir)
	395	+ finally:
	396	+ stream.close()
	397	+ except:
	398	+ log_msg(_("FAILED: unable to connect to server"), log)
	399	+ print traceback.format_exc()
	400	+ result = False
	401	+ if log:
	402	+ log.put(None)
	403	+ return result
	404	+
	405	+def run_return(login, passwd, host, port, cert, files, reason, src_dir, file_exts, log=None):
	406	+ result = True
	407	+ try:
	408	+ stream = init_stream(host, port, cert, log=log)
	409	+ try:
	410	+ if run_auth(stream, login, passwd, log=log):
	411	+ return_files(stream, files, reason, src_dir, file_exts, log)
	412	+ finally:
	413	+ stream.close()
	414	+ except:
	415	+ log_msg(_("FAILED: unable to connect to server"), log)
	416	+ print traceback.format_exc()
	417	+ result = False
	418	+ if log:
	419	+ log.put(None)
	420	+ return result
	421	+
	422	+def log_msg(msg, log, new_line=True):
	423	+ if new_line:
	424	+ msg = msg + "\n"
	425	+ sys.stdout.write(msg.encode('utf-8'))
	426	+ if log:
	427	+ log.put(msg)
	428	+
	429	+if __name__ == "__main__":
	430	+
	431	+ optparser = OptionParser(usage="""usage: %prog [options] CMD CMD-ARGS
	432	+
	433	+ Command line client for files distribution system.""")
	434	+
	435	+ optparser.add_option("--login", dest="login")
	436	+ optparser.add_option("--passwd", dest="passwd")
	437	+ optparser.add_option("--home", metavar="DIR", dest="home",
	438	+ help="Directory with users files.")
	439	+
	440	+ (options, args) = optparser.parse_args()
	441	+
	442	+ if options.login == None:
	443	+ optparser.print_help()
	444	+ print "\n--login option is mandatory"
	445	+ sys.exit(0)
	446	+ if options.passwd == None:
	447	+ optparser.print_help()
	448	+ print "\n--passwd option is mandatory"
	449	+ sys.exit(0)
	450	+ if options.home == None:
	451	+ optparser.print_help()
	452	+ print "\n--home option is mandatory"
	453	+ sys.exit(0)
	454	+
	455	+ commands = ["upload", "download", "download2"]
	456	+ if len(args) < 1 or args[0] not in commands:
	457	+ optparser.print_help()
	458	+ print "\nCMD should be one of the following:"
	459	+ print commands
	460	+ sys.exit(0)
	461	+
	462	+ cmd = args[0]
	463	+ if cmd == "upload":
	464	+ run_upload(options.login, options.passwd, args[1:], options.home)
	465	+ elif cmd == "download":
	466	+ run_download(options.login, options.passwd,
	467	+ int(args[1]), options.home)
	468	+ elif cmd == "download2":
	469	+ run_download_prim(options.login, options.passwd,
	470	+ int(args[1]), options.home)
...	...

gui/const.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/const.py
	1	+# -- coding: utf-8 --
	2	+import os
	3	+
	4	+from dfs.config import Config
	5	+
	6	+# Global configuration file
	7	+global_config_name = "data/global.cfg"
	8	+_cfg = Config(global_config_name)
	9	+
	10	+# File with list of directories
	11	+dir_cache_name = _cfg["general.dir_cache"]
	12	+
	13	+# File with directory configuration
	14	+config_name = _cfg["general.config"]
	15	+# File with file names marked as ready
	16	+ready_name = _cfg["general.ready"]
	17	+# File with files footprints
	18	+footprints_name = _cfg["general.footprints"]
	19	+# Default file extensions
	20	+default_exts = _cfg["general.default_exts"].split()
	21	+# Language (pl or en)
	22	+lang = _cfg["general.lang"]
	23	+# option to hide dir menu if precofigured
	24	+hide_dir_menu = _cfg["general.hide_dir_menu"]
	25	+
	26	+program = _cfg["general.program"]
	27	+
	28	+extension = _cfg["general.extension"]
	29	+
	30	+conn_host = _cfg["connection.host"]
	31	+conn_port = int(_cfg["connection.port"])
	32	+conn_cert = _cfg["connection.cert"]
	33	+
	34	+# Path to directory-specific configuration files
	35	+def path(p, name):
	36	+ return os.path.join(p, name)
...	...

gui/data/.dir.lst 0 → 100644

View file @44cbbee

	1	+++ a/gui/data/.dir.lst
	1	+/home/me2/workspace/dist-system/data/foldery_anotatorow/ann1
	2	+/home/me2/workspace/dist-system/data/foldery_anotatorow
	3	+/home/me2/workspace/core/dist-system/data/annotators_folders/ann2
	4	+/home/me2/workspace/core/dist-system/data/annotators_folders/ann1
	5	+/home/me2/workspace/core/dist-system/data/annotators_folders/adj1
...	...

gui/data/cert.pem 0 → 100644

View file @44cbbee

	1	+++ a/gui/data/cert.pem
	1	+-----BEGIN CERTIFICATE-----
	2	+MIICkDCCAfmgAwIBAgIJAJPcESSEV86nMA0GCSqGSIb3DQEBBQUAMGExCzAJBgNV
	3	+BAYTAlBMMQ0wCwYDVQQIDARUZXN0MQ0wCwYDVQQHDARDaXR5MRAwDgYDVQQKDAdD
	4	+b21wYW55MSIwIAYJKoZIhvcNAQkBFhNleGFtcGxlQGV4YW1wbGUuY29tMB4XDTEz
	5	+MDEyMzEyMjIwN1oXDTE0MDEyMzEyMjIwN1owYTELMAkGA1UEBhMCUEwxDTALBgNV
	6	+BAgMBFRlc3QxDTALBgNVBAcMBENpdHkxEDAOBgNVBAoMB0NvbXBhbnkxIjAgBgkq
	7	+hkiG9w0BCQEWE2V4YW1wbGVAZXhhbXBsZS5jb20wgZ8wDQYJKoZIhvcNAQEBBQAD
	8	+gY0AMIGJAoGBAKUG9QHjUiCSjcvFQl1OqUgZ8c4Vzm7m7Ua7D33YDnGo3QGuhPML
	9	+0JB+JPBG++MrPdQqMV8eeXe1dFlrm6SHnrEZIhwZg8iDnPhFKNjHiAkx0PCQdI93
	10	+rAe4EcszkgbQCXXLGjQJNDikwGZ6ciylJ7C2XewWTlWjv7/LqMwhQotLAgMBAAGj
	11	+UDBOMB0GA1UdDgQWBBRLRvOFIo9LIeiT2ohQalEzy687ijAfBgNVHSMEGDAWgBRL
	12	+RvOFIo9LIeiT2ohQalEzy687ijAMBgNVHRMEBTADAQH/MA0GCSqGSIb3DQEBBQUA
	13	+A4GBAD1odtgH1kZ4a0TEbwjK2PaHTYyofkkgeXsGGnG3eMkwKQ7PHJarBl7GtxP5
	14	+Ls91k/KvBuNqCM/lPmM94USDSXrKGe0Zzc9WZbDG9SXO23gGOwPl+Tg9v1ocRHd2
	15	+dYYIgZM8/tLcsHyNNMd7c4BOMD4rzkjgbThFFMl/2NSkvrO7
	16	+-----END CERTIFICATE-----
...	...

gui/data/global.cfg 0 → 100644

View file @44cbbee

	1	+++ a/gui/data/global.cfg
	1	+[general]
	2	+
	3	+config = .dir.cfg
	4	+ready = .ready.lst
	5	+footprints = .footprints.lst
	6	+default_exts = .mmax _mentions.xml _words.xml
	7	+lang = pl
	8	+hide_dir_menu = no
	9	+program = mmax
	10	+extension = .mmax
	11	+
	12	+{paths}
	13	+dir_cache = .dir.lst
	14	+
	15	+[connection]
	16	+
	17	+host = localhost
	18	+port = 2225
	19	+
	20	+{paths}
	21	+cert = cert.pem
...	...

gui/dfs.wxg 0 → 100644

View file @44cbbee

	1	+++ a/gui/dfs.wxg
	1	+<?xml version="1.0"?>
	2	+<!-- generated by wxGlade 0.6.3 on Fri Sep 30 18:28:38 2011 -->
	3	+
	4	+<application path="/home/kuba/Pulpit/praca/nkjp/dist-system/gui" name="manager" class="FileManager" option="1" language="python" top_window="main_frame" encoding="UTF-8" use_gettext="0" overwrite="0" use_new_namespace="1" for_version="2.8" is_template="0">
	5	+ <object class="MainFrame" name="main_frame" base="EditFrame">
	6	+ <style>wxDEFAULT_FRAME_STYLE</style>
	7	+ <title>--</title>
	8	+ <menubar>1</menubar>
	9	+ <centered>1</centered>
	10	+ <focused>1</focused>
	11	+ <size>663, 556</size>
	12	+ <object class="wxMenuBar" name="frame_1_menubar" base="EditMenuBar">
	13	+ <menus>
	14	+ <menu name="dir_menu" label="Directory">
	15	+ <item>
	16	+ <label>Open</label>
	17	+ <id>5</id>
	18	+ <name>dir_menu_open</name>
	19	+ <help_str>Open new directory</help_str>
	20	+ <handler>open_directory</handler>
	21	+ </item>
	22	+ <item>
	23	+ <label>Reconfigure</label>
	24	+ <id>6</id>
	25	+ <help_str>Reconfigure directory</help_str>
	26	+ <handler>reconf_directory</handler>
	27	+ </item>
	28	+ <item>
	29	+ <label>---</label>
	30	+ <id>---</id>
	31	+ <name>---</name>
	32	+ </item>
	33	+ </menu>
	34	+ <menu name="" label="Files">
	35	+ <item>
	36	+ <label>Upload Selected</label>
	37	+ <id>1</id>
	38	+ <help_str>Upload annotated or adjudicated files</help_str>
	39	+ <handler>upload</handler>
	40	+ </item>
	41	+ <item>
	42	+ <label>Checkin Selected</label>
	43	+ <id>8</id>
	44	+ <help_str>Upload annotated or adjudicated; files will be deleted from local disk and you will not be able to modify them again</help_str>
	45	+ <handler>checkin</handler>
	46	+ </item>
	47	+ <item>
	48	+ <label>Download (annotation)</label>
	49	+ <id>2</id>
	50	+ <help_str>Download files for annotation</help_str>
	51	+ <handler>download</handler>
	52	+ </item>
	53	+ <item>
	54	+ <label>Download (adjudication)</label>
	55	+ <id>3</id>
	56	+ <help_str>Download files for adjudication</help_str>
	57	+ <handler>download_prim</handler>
	58	+ </item>
	59	+ <item>
	60	+ <label>Checkout</label>
	61	+ <id>7</id>
	62	+ <help_str>Checkout files from server to your local, empty directory</help_str>
	63	+ <handler>checkout</handler>
	64	+ </item>
	65	+ </menu>
	66	+ <menu name="" label="Select">
	67	+ <item>
	68	+ <label>Ready</label>
	69	+ <id>4</id>
	70	+ <help_str>Select items which are marked for upload</help_str>
	71	+ <handler>select_ready</handler>
	72	+ </item>
	73	+ <item>
	74	+ <label>Modified</label>
	75	+ <id>9</id>
	76	+ <help_str>Select items which are modified</help_str>
	77	+ <handler>select_modified</handler>
	78	+ </item>
	79	+ </menu>
	80	+ <menu name="" label="Help">
	81	+ </menu>
	82	+ </menus>
	83	+ </object>
	84	+ <object class="wxBoxSizer" name="sizer_6" base="EditBoxSizer">
	85	+ <orient>wxHORIZONTAL</orient>
	86	+ <object class="sizeritem">
	87	+ <flag>wxEXPAND</flag>
	88	+ <border>0</border>
	89	+ <option>1</option>
	90	+ <object class="wxSplitterWindow" name="window_1" base="EditSplitterWindow">
	91	+ <style>wxSP_3D\|wxSP_BORDER</style>
	92	+ <orientation>wxSPLIT_HORIZONTAL</orientation>
	93	+ <sash_pos>-100</sash_pos>
	94	+ <window_2>window_1_pane_2</window_2>
	95	+ <window_1>window_1_pane_1</window_1>
	96	+ <object class="wxPanel" name="window_1_pane_1" base="EditPanel">
	97	+ <style>wxTAB_TRAVERSAL</style>
	98	+ <object class="wxBoxSizer" name="sizer_1" base="EditBoxSizer">
	99	+ <orient>wxVERTICAL</orient>
	100	+ <object class="sizeritem">
	101	+ <flag>wxEXPAND</flag>
	102	+ <border>0</border>
	103	+ <option>1</option>
	104	+ <object class="wxNotebook" name="notebook_1" base="EditNotebook">
	105	+ <style>0</style>
	106	+ <tabs>
	107	+ <tab window="notebook_1_pane_1">annotation</tab>
	108	+ <tab window="notebook_1_pane_2">adjudication</tab>
	109	+ </tabs>
	110	+ <object class="wxPanel" name="notebook_1_pane_1" base="EditPanel">
	111	+ <style>wxTAB_TRAVERSAL</style>
	112	+ <object class="wxBoxSizer" name="sizer_2" base="EditBoxSizer">
	113	+ <orient>wxVERTICAL</orient>
	114	+ <object class="sizeritem">
	115	+ <flag>wxEXPAND</flag>
	116	+ <border>0</border>
	117	+ <option>1</option>
	118	+ <object class="wxListCtrl" name="files_list" base="EditListCtrl">
	119	+ <style>wxLC_REPORT\|wxSIMPLE_BORDER</style>
	120	+ <events>
	121	+ <handler event="EVT_LIST_ITEM_ACTIVATED">activate_item</handler>
	122	+ </events>
	123	+ </object>
	124	+ </object>
	125	+ </object>
	126	+ </object>
	127	+ <object class="wxPanel" name="notebook_1_pane_2" base="EditPanel">
	128	+ <style>wxTAB_TRAVERSAL</style>
	129	+ <object class="wxBoxSizer" name="sizer_3" base="EditBoxSizer">
	130	+ <orient>wxVERTICAL</orient>
	131	+ <object class="sizeritem">
	132	+ <flag>wxEXPAND</flag>
	133	+ <border>0</border>
	134	+ <option>1</option>
	135	+ <object class="wxListCtrl" name="super_files_list" base="EditListCtrl">
	136	+ <style>wxLC_REPORT\|wxSIMPLE_BORDER</style>
	137	+ <events>
	138	+ <handler event="EVT_LIST_ITEM_ACTIVATED">activate_super_item</handler>
	139	+ </events>
	140	+ </object>
	141	+ </object>
	142	+ </object>
	143	+ </object>
	144	+ </object>
	145	+ </object>
	146	+ </object>
	147	+ </object>
	148	+ <object class="wxPanel" name="window_1_pane_2" base="EditPanel">
	149	+ <style>wxTAB_TRAVERSAL</style>
	150	+ <object class="wxBoxSizer" name="sizer_7" base="EditBoxSizer">
	151	+ <orient>wxVERTICAL</orient>
	152	+ <object class="sizeritem">
	153	+ <flag>wxEXPAND</flag>
	154	+ <border>0</border>
	155	+ <option>1</option>
	156	+ <object class="wxTextCtrl" name="log_ctrl" base="EditTextCtrl">
	157	+ <style>wxTE_MULTILINE\|wxTE_READONLY</style>
	158	+ </object>
	159	+ </object>
	160	+ </object>
	161	+ </object>
	162	+ </object>
	163	+ </object>
	164	+ </object>
	165	+ </object>
	166	+ <object class="LoginDialog" name="login_dialog" base="EditDialog">
	167	+ <style>wxDEFAULT_DIALOG_STYLE\|wxRESIZE_BORDER\|wxTHICK_FRAME</style>
	168	+ <title>login</title>
	169	+ <object class="wxBoxSizer" name="sizer_4" base="EditBoxSizer">
	170	+ <orient>wxVERTICAL</orient>
	171	+ <object class="sizeritem">
	172	+ <border>0</border>
	173	+ <option>0</option>
	174	+ <object class="wxGridSizer" name="grid_sizer_1" base="EditGridSizer">
	175	+ <hgap>0</hgap>
	176	+ <rows>2</rows>
	177	+ <cols>2</cols>
	178	+ <vgap>0</vgap>
	179	+ <object class="sizeritem">
	180	+ <flag>wxALIGN_CENTER_VERTICAL</flag>
	181	+ <border>0</border>
	182	+ <option>0</option>
	183	+ <object class="wxStaticText" name="label_1" base="EditStaticText">
	184	+ <attribute>1</attribute>
	185	+ <label>login: </label>
	186	+ </object>
	187	+ </object>
	188	+ <object class="sizeritem">
	189	+ <border>0</border>
	190	+ <option>0</option>
	191	+ <object class="wxTextCtrl" name="login_ctrl" base="EditTextCtrl">
	192	+ </object>
	193	+ </object>
	194	+ <object class="sizeritem">
	195	+ <flag>wxALIGN_CENTER_VERTICAL</flag>
	196	+ <border>0</border>
	197	+ <option>0</option>
	198	+ <object class="wxStaticText" name="label_3" base="EditStaticText">
	199	+ <attribute>1</attribute>
	200	+ <label>password: </label>
	201	+ </object>
	202	+ </object>
	203	+ <object class="sizeritem">
	204	+ <border>0</border>
	205	+ <option>0</option>
	206	+ <object class="wxTextCtrl" name="passwd_ctrl" base="EditTextCtrl">
	207	+ <style>wxTE_PASSWORD</style>
	208	+ </object>
	209	+ </object>
	210	+ </object>
	211	+ </object>
	212	+ <object class="sizeritem">
	213	+ <border>0</border>
	214	+ <option>0</option>
	215	+ <object class="wxCheckBox" name="save_passwd" base="EditCheckBox">
	216	+ <label>save password</label>
	217	+ </object>
	218	+ </object>
	219	+ <object class="sizeritem">
	220	+ <flag>wxALIGN_CENTER_HORIZONTAL</flag>
	221	+ <border>0</border>
	222	+ <option>0</option>
	223	+ <object class="wxButton" name="button_1" base="EditButton">
	224	+ <label>OK</label>
	225	+ <id>wx.ID_OK</id>
	226	+ <events>
	227	+ <handler event="EVT_BUTTON">on_ok</handler>
	228	+ </events>
	229	+ <size>85, 32</size>
	230	+ </object>
	231	+ </object>
	232	+ </object>
	233	+ </object>
	234	+ <object class="DownloadNumberDialog" name="download_number" base="EditDialog">
	235	+ <style>wxDEFAULT_DIALOG_STYLE</style>
	236	+ <title>checkout</title>
	237	+ <centered>1</centered>
	238	+ <object class="wxGridSizer" name="grid_sizer_2" base="EditGridSizer">
	239	+ <hgap>0</hgap>
	240	+ <rows>2</rows>
	241	+ <cols>2</cols>
	242	+ <vgap>0</vgap>
	243	+ <object class="sizeritem">
	244	+ <flag>wxALIGN_CENTER_HORIZONTAL\|wxALIGN_CENTER_VERTICAL</flag>
	245	+ <border>0</border>
	246	+ <option>0</option>
	247	+ <object class="wxStaticText" name="label_4" base="EditStaticText">
	248	+ <attribute>1</attribute>
	249	+ <tooltip>Number of files to download</tooltip>
	250	+ <label>download:</label>
	251	+ </object>
	252	+ </object>
	253	+ <object class="sizeritem">
	254	+ <border>0</border>
	255	+ <option>0</option>
	256	+ <object class="wxSpinCtrl" name="checkout_number" base="EditSpinCtrl">
	257	+ <range>1, 300</range>
	258	+ <value>1</value>
	259	+ </object>
	260	+ </object>
	261	+ <object class="sizeritem">
	262	+ <flag>wxALIGN_CENTER_HORIZONTAL\|wxALIGN_CENTER_VERTICAL</flag>
	263	+ <border>0</border>
	264	+ <option>0</option>
	265	+ <object class="wxButton" name="button_4" base="EditButton">
	266	+ <label>OK</label>
	267	+ <id>wx.ID_YES</id>
	268	+ <events>
	269	+ <handler event="EVT_BUTTON">on_ok</handler>
	270	+ </events>
	271	+ </object>
	272	+ </object>
	273	+ <object class="sizeritem">
	274	+ <flag>wxALIGN_CENTER_HORIZONTAL\|wxALIGN_CENTER_VERTICAL</flag>
	275	+ <border>0</border>
	276	+ <option>0</option>
	277	+ <object class="wxButton" name="button_5" base="EditButton">
	278	+ <label>Cancel</label>
	279	+ <id>wx.ID_NO</id>
	280	+ <events>
	281	+ <handler event="EVT_BUTTON">on_cancel</handler>
	282	+ </events>
	283	+ </object>
	284	+ </object>
	285	+ </object>
	286	+ </object>
	287	+ <object class="ConfigDialog" name="config_dialog" base="EditDialog">
	288	+ <style>wxDEFAULT_DIALOG_STYLE</style>
	289	+ <title>Directory configuration</title>
	290	+ <object class="wxBoxSizer" name="sizer_5" base="EditBoxSizer">
	291	+ <orient>wxVERTICAL</orient>
	292	+ <object class="sizeritem">
	293	+ <border>0</border>
	294	+ <option>0</option>
	295	+ <object class="wxGridSizer" name="grid_sizer_4" base="EditGridSizer">
	296	+ <hgap>0</hgap>
	297	+ <rows>3</rows>
	298	+ <cols>2</cols>
	299	+ <vgap>0</vgap>
	300	+ <object class="sizeritem">
	301	+ <flag>wxALIGN_CENTER_VERTICAL</flag>
	302	+ <border>0</border>
	303	+ <option>0</option>
	304	+ <object class="wxStaticText" name="label_2" base="EditStaticText">
	305	+ <attribute>1</attribute>
	306	+ <tooltip>Login supplied by system administrator</tooltip>
	307	+ <label>login:</label>
	308	+ </object>
	309	+ </object>
	310	+ <object class="sizeritem">
	311	+ <flag>wxALIGN_CENTER_VERTICAL</flag>
	312	+ <border>0</border>
	313	+ <option>0</option>
	314	+ <object class="wxTextCtrl" name="login_ctrl" base="EditTextCtrl">
	315	+ </object>
	316	+ </object>
	317	+ <object class="sizeritem">
	318	+ <flag>wxALIGN_CENTER_VERTICAL</flag>
	319	+ <border>0</border>
	320	+ <option>0</option>
	321	+ <object class="wxStaticText" name="label_6" base="EditStaticText">
	322	+ <attribute>1</attribute>
	323	+ <tooltip>Password supplied by system administrator</tooltip>
	324	+ <label>password:</label>
	325	+ </object>
	326	+ </object>
	327	+ <object class="sizeritem">
	328	+ <flag>wxALIGN_CENTER_VERTICAL</flag>
	329	+ <border>0</border>
	330	+ <option>0</option>
	331	+ <object class="wxTextCtrl" name="passwd_ctrl" base="EditTextCtrl">
	332	+ <style>wxTE_PASSWORD</style>
	333	+ </object>
	334	+ </object>
	335	+ <object class="sizeritem">
	336	+ <flag>wxALIGN_CENTER_VERTICAL</flag>
	337	+ <border>0</border>
	338	+ <option>0</option>
	339	+ <object class="wxStaticText" name="label_5" base="EditStaticText">
	340	+ <attribute>1</attribute>
	341	+ <tooltip>List of space separated file extensions</tooltip>
	342	+ <label>extensions:</label>
	343	+ </object>
	344	+ </object>
	345	+ <object class="sizeritem">
	346	+ <flag>wxALIGN_CENTER_VERTICAL</flag>
	347	+ <border>0</border>
	348	+ <option>0</option>
	349	+ <object class="wxTextCtrl" name="exts_ctrl" base="EditTextCtrl">
	350	+ </object>
	351	+ </object>
	352	+ </object>
	353	+ </object>
	354	+ <object class="sizeritem">
	355	+ <flag>wxALIGN_CENTER_HORIZONTAL</flag>
	356	+ <border>0</border>
	357	+ <option>0</option>
	358	+ <object class="wxButton" name="button_2" base="EditButton">
	359	+ <label>OK</label>
	360	+ <id>wx.ID_OK</id>
	361	+ <focused>1</focused>
	362	+ <size>85, 29</size>
	363	+ </object>
	364	+ </object>
	365	+ </object>
	366	+ </object>
	367	+</application>
...	...

gui/dfs/__init__.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/dfs/__init__.py
...	...

gui/dfs/config.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/dfs/config.py
	1	+# -- coding: utf-8 --
	2	+import re
	3	+import os
	4	+
	5	+SECTION = re.compile("^\[(.*)\]$")
	6	+SUBSECTION = re.compile("^\{(.*)\}$")
	7	+ENTRY = re.compile("^([^=\s]+)\s=\s([^=]+)\s*$")
	8	+
	9	+def cut_comment(s):
	10	+ return s.split("#")[0]
	11	+
	12	+class Config:
	13	+
	14	+ def __init__(self, path):
	15	+ section = None
	16	+ subsection = None
	17	+ self.d = {}
	18	+ with open(path) as f:
	19	+ for line in f:
	20	+ line = cut_comment(line).strip()
	21	+
	22	+ m = SECTION.search(line)
	23	+ if m is not None:
	24	+ section = m.group(1)
	25	+ subsection = None
	26	+ continue
	27	+
	28	+ m = SUBSECTION.search(line)
	29	+ if m is not None:
	30	+ subsection = m.group(1)
	31	+ continue
	32	+
	33	+ m = ENTRY.search(line)
	34	+ if m is not None:
	35	+ key = m.group(1)
	36	+ val = m.group(2)
	37	+ if subsection == "paths":
	38	+ # print path, val, os.path.join(path, val)
	39	+ val = self.relative_path(val, path)
	40	+ if section is not None:
	41	+ self.d[section + "." + key] = val
	42	+ else:
	43	+ self.d[key] = val
	44	+
	45	+ def relative_path(self, path, ref):
	46	+ return os.path.join(os.path.dirname(ref), path)
	47	+
	48	+ def __getitem__(self, key):
	49	+ return self.d[key]
...	...

gui/dfs/database.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/dfs/database.py
	1	+# -- coding: utf-8 --
	2	+import time
	3	+from datetime import date, datetime
	4	+from collections import defaultdict
	5	+
	6	+from xml.etree.ElementTree import Element, ElementTree, tostring
	7	+import xml.etree.ElementTree as ET
	8	+
	9	+class Database:
	10	+
	11	+ def __init__(self, db, anno_per_file, from_file=True):
	12	+ if from_file:
	13	+ self.db_name = db
	14	+ self.tree = ET.parse(db)
	15	+ self.root = self.tree.getroot()
	16	+ else:
	17	+ self.db_name = None
	18	+ self.tree = None
	19	+ self.root = ET.fromstring(db)
	20	+
	21	+ self.anno_per_file = anno_per_file
	22	+ self.make_index()
	23	+
	24	+ def owned(self, ann_elem):
	25	+ return not self.finished(ann_elem) and not self.returned(ann_elem)
	26	+
	27	+ def finished(self, ann_elem):
	28	+ return ann_elem.find("checkinDate") is not None
	29	+
	30	+ def returned(self, ann_elem):
	31	+ return ann_elem.find("return") is not None
	32	+
	33	+ def get_reason(self, ann_elem):
	34	+ reas = ann_elem.find("return").find("reason").text
	35	+ if reas is None:
	36	+ reas = ""
	37	+ return reas
	38	+
	39	+ def rejected(self, file_elem):
	40	+ return file_elem.find("rejected") is not None
	41	+
	42	+ def fixed(self, ann_elem):
	43	+ ret = ann_elem.find("return")
	44	+ if ret is not None and ret.find("fixed") is not None:
	45	+ return True
	46	+ return False
	47	+
	48	+ def ann_elem_for_user(self, file_elem, user):
	49	+ idx = 0
	50	+ for ann_elem in file_elem.findall("ann"):
	51	+ if ann_elem.find("annName").text == user:
	52	+ return ann_elem, idx
	53	+ idx = idx + 1
	54	+ return None, None
	55	+
	56	+ def sann_elem_for_user(self, file_elem, user):
	57	+ for ann_elem in file_elem.findall("s_ann"):
	58	+ if ann_elem.find("annName").text == user:
	59	+ return ann_elem
	60	+ return None
	61	+
	62	+ def fixed_for_user(self, file_elem, user, is_adj):
	63	+ if is_adj:
	64	+ ann = self.sann_elem_for_user(file_elem, user)
	65	+ else:
	66	+ ann, idx = self.ann_elem_for_user(file_elem, user)
	67	+ if ann is not None:
	68	+ return self.fixed(ann)
	69	+ return False
	70	+
	71	+ def make_index(self):
	72	+ self.file_index = {}
	73	+ self.ann_owned_index = defaultdict(list)
	74	+ self.adj_owned_index = defaultdict(list)
	75	+
	76	+ for file_elem in self.root:
	77	+ name_elem = file_elem.find("name")
	78	+ if name_elem == None:
	79	+ raise Exception("No name assigned to a file element !")
	80	+ self.file_index[name_elem.text] = file_elem
	81	+
	82	+ if self.rejected(file_elem):
	83	+ continue
	84	+
	85	+ for ann_elem in file_elem.findall("ann"):
	86	+ if self.owned(ann_elem):
	87	+ ann_name = ann_elem.find("annName").text
	88	+ self.ann_owned_index[ann_name].append(file_elem)
	89	+
	90	+ for ann_elem in file_elem.findall("s_ann"):
	91	+ if self.owned(ann_elem):
	92	+ ann_name = ann_elem.find("annName").text
	93	+ self.adj_owned_index[ann_name].append(file_elem)
	94	+
	95	+ def fix(self, ann_elem):
	96	+ if not self.returned(ann_elem):
	97	+ raise Exception("File not returned in database!")
	98	+ if self.fixed(ann_elem):
	99	+ raise Exception("File already fixed in database!")
	100	+
	101	+ ret = ann_elem.find("return")
	102	+ fixed = ET.SubElement(ret, "fixed")
	103	+
	104	+ def add(self, file_name):
	105	+ if self.file_index.has_key(file_name):
	106	+ raise Exception("File name already in database !")
	107	+ file_elem = ET.SubElement(self.root, "file")
	108	+ name_elem = ET.SubElement(file_elem, "name")
	109	+ name_elem.text = file_name
	110	+ date_elem = ET.SubElement(file_elem, "addDate")
	111	+ date_elem.text = time.strftime("%c")
	112	+ self.file_index[file_name] = file_elem
	113	+
	114	+ def remove(self, file_name):
	115	+ if not self.file_index.has_key(file_name):
	116	+ raise Exception("File name not in database !")
	117	+ file_elem = self.file_index[file_name]
	118	+ self.root.remove(file_elem)
	119	+ self.make_index()
	120	+
	121	+ def reject(self, file_name, reason):
	122	+ if not self.file_index.has_key(file_name):
	123	+ raise Exception("File name not in database !")
	124	+ file_elem = self.file_index[file_name]
	125	+ if self.rejected(file_elem):
	126	+ raise Exception("File already rejected !")
	127	+ rej_elem = ET.SubElement(file_elem, "rejected")
	128	+ rej_elem.text = reason
	129	+ self.make_index()
	130	+
	131	+ # For prettyprint, used in 'save' method.
	132	+ def indent(self, elem, level=0):
	133	+ i = "\n" + level * " "
	134	+ if len(elem):
	135	+ if not elem.text or not elem.text.strip():
	136	+ elem.text = i + " "
	137	+ if not elem.tail or not elem.tail.strip():
	138	+ elem.tail = i
	139	+ for elem in elem:
	140	+ self.indent(elem, level + 1)
	141	+ if not elem.tail or not elem.tail.strip():
	142	+ elem.tail = i
	143	+ else:
	144	+ if level and (not elem.tail or not elem.tail.strip()):
	145	+ elem.tail = i
	146	+
	147	+ def save(self):
	148	+ if not self.db_name:
	149	+ raise Exception("XML not read from file !")
	150	+
	151	+ self.indent(self.root)
	152	+ self.tree.write(self.db_name, encoding="utf-8")
	153	+
	154	+ def upload_prevention(self, file_name, user, is_super):
	155	+ if not self.file_index.has_key(file_name):
	156	+ return "Filename " + file_name.encode('utf-8') + " not known by server."
	157	+ file_elem = self.file_index[file_name]
	158	+ if self.rejected(file_elem):
	159	+ return "File rejected: " + file_name.encode('utf-8')
	160	+
	161	+ if is_super:
	162	+ ann_elem = file_elem.find("s_ann")
	163	+ if ann_elem is None:
	164	+ return "No superannotator assigned to file " + file_name.encode('utf-8')
	165	+
	166	+ if user != ann_elem.find("annName").text:
	167	+ return "Different superannotator assigned to file " + file_name.encode('utf-8')
	168	+
	169	+ if ann_elem.find("checkinDate") is not None:
	170	+ return "File " + file_name.encode('utf-8') + " already checked in!"
	171	+
	172	+ return None
	173	+
	174	+ else:
	175	+ annotations = file_elem.findall("ann")
	176	+ owners = map(lambda ann: ann.find("annName").text, annotations)
	177	+ if not user in owners:
	178	+ return "User " + user + " doesn't own the file " + file_name.encode('utf-8')
	179	+
	180	+ i = owners.index(user)
	181	+ ann_elem = annotations[i]
	182	+ if ann_elem.find("checkinDate") is not None:
	183	+ return "User " + user + " already checked in the file " + file_name.encode('utf-8')
	184	+
	185	+ return None
	186	+
	187	+ def upload_dest(self, file_name, user):
	188	+ """Upload destination (annName element and ID -- 1 or 2) directory."""
	189	+ file_elem = self.file_index[file_name]
	190	+ annotations = file_elem.findall("ann")
	191	+
	192	+ owners = map(lambda ann: ann.find("annName").text, annotations)
	193	+ exc = Exception("Cannot upload " + file_name.encode('utf-8')
	194	+ + " file by " + user + " annotator !")
	195	+ if not user in owners:
	196	+ raise exc
	197	+
	198	+ i = owners.index(user)
	199	+ ann_elem = annotations[i]
	200	+ if ann_elem.find("checkinDate") is not None:
	201	+ raise exc
	202	+
	203	+ return (ann_elem, i)
	204	+
	205	+ def upload_id(self, file_name, user):
	206	+ return self.upload_dest(file_name, user)[1]
	207	+
	208	+ def return_file(self, file_name, user, reason):
	209	+ (ann_elem, i) = self.upload_dest(file_name, user)
	210	+ ret_elem = ET.SubElement(ann_elem, "return")
	211	+ date_elem = ET.SubElement(ret_elem, "date")
	212	+ date_elem.text = time.strftime("%c")
	213	+ date_elem = ET.SubElement(ret_elem, "reason")
	214	+ if reason is None:
	215	+ reason = ""
	216	+ date_elem.text = reason
	217	+ return i
	218	+
	219	+ def return_file_prim(self, file_name, user, reason):
	220	+ file_elem = self.file_index[file_name]
	221	+ ann_elem = file_elem.find("s_ann")
	222	+
	223	+ if (user != ann_elem.find("annName").text or
	224	+ ann_elem.find("checkinDate") is not None):
	225	+ raise Exception("Cannot upload " + file_name.encode('utf-8')
	226	+ + " file by " + user + " annotator !")
	227	+
	228	+ ret_elem = ET.SubElement(ann_elem, "return")
	229	+ date_elem = ET.SubElement(ret_elem, "date")
	230	+ date_elem.text = time.strftime("%c")
	231	+ date_elem = ET.SubElement(ret_elem, "reason")
	232	+ if reason is None:
	233	+ reason = ""
	234	+ date_elem.text = reason
	235	+
	236	+ def upload(self, file_name, user):
	237	+ (ann_elem, i) = self.upload_dest(file_name, user)
	238	+ date_elem = ET.SubElement(ann_elem, "checkinDate")
	239	+ date_elem.text = time.strftime("%c")
	240	+ return i
	241	+
	242	+ def upload_prim(self, file_name, user):
	243	+ file_elem = self.file_index[file_name]
	244	+ ann_elem = file_elem.find("s_ann")
	245	+
	246	+ if (user != ann_elem.find("annName").text or self.finished(ann_elem)):
	247	+ raise Exception("Cannot upload " + file_name.encode('utf-8')
	248	+ + " file by " + user + " annotator !")
	249	+
	250	+ date_elem = ET.SubElement(ann_elem, "checkinDate")
	251	+ date_elem.text = time.strftime("%c")
	252	+
	253	+ def download(self, file_name, user):
	254	+ file_elem = self.file_index[file_name]
	255	+
	256	+ annotations = file_elem.findall("ann")
	257	+ owners = map(lambda ann: ann.find("annName").text, annotations)
	258	+
	259	+ if self.fixed_for_user(file_elem, user, False):
	260	+ ann, idx = self.ann_elem_for_user(file_elem, user)
	261	+ date = ann.find("return").find("date").text
	262	+ ann.remove(ann.find("return"))
	263	+
	264	+ date_elem = ET.SubElement(ann, "returnDate")
	265	+ date_elem.text = date
	266	+
	267	+ date_elem = ET.SubElement(ann, "checkoutDate")
	268	+ date_elem.text = time.strftime("%c")
	269	+
	270	+ return idx
	271	+
	272	+ else:
	273	+ if user in owners or len(owners) + 1 > self.anno_per_file:
	274	+ raise Exception("Cannot set " + user + " annotator to '"
	275	+ + file_name.encode('utf-8') + "' file !")
	276	+
	277	+ ann_elem = ET.SubElement(file_elem, "ann")
	278	+ ann_name_elem = ET.SubElement(ann_elem, "annName")
	279	+ ann_name_elem.text = user
	280	+
	281	+ date_elem = ET.SubElement(ann_elem, "checkoutDate")
	282	+ date_elem.text = time.strftime("%c")
	283	+
	284	+ return None
	285	+
	286	+ def download_prim(self, file_name, user):
	287	+ file_elem = self.file_index[file_name]
	288	+
	289	+ if self.fixed_for_user(file_elem, user, True):
	290	+ sann = self.sann_elem_for_user(file_elem, user)
	291	+ date = sann.find("return").find("date").text
	292	+ sann.remove(sann.find("return"))
	293	+
	294	+ date_elem = ET.SubElement(sann, "returnDate")
	295	+ date_elem.text = date
	296	+
	297	+ date_elem = ET.SubElement(sann, "checkoutDate")
	298	+ date_elem.text = time.strftime("%c")
	299	+
	300	+ return True
	301	+
	302	+ else:
	303	+ if len(file_elem.findall("s_ann")) > 0:
	304	+ raise Exception("Cannot set " + user + " adjudicator to '"
	305	+ + file_name.encode('utf-8') + "' file !")
	306	+
	307	+ ann_elem = ET.SubElement(file_elem, "s_ann")
	308	+ ann_name_elem = ET.SubElement(ann_elem, "annName")
	309	+ ann_name_elem.text = user
	310	+
	311	+ date_elem = ET.SubElement(ann_elem, "checkoutDate")
	312	+ date_elem.text = time.strftime("%c")
	313	+
	314	+ return False
	315	+
	316	+ def for_annotation(self, user):
	317	+ priority = []
	318	+ result = []
	319	+ for file_elem in self.root:
	320	+ if self.rejected(file_elem) or file_elem.find("s_ann") is not None:
	321	+ continue
	322	+
	323	+ anns = file_elem.findall("ann")
	324	+ owners = map(lambda ann: ann.find("annName").text, anns)
	325	+ if len(owners) < self.anno_per_file and user not in owners:
	326	+ result.append(file_elem.find("name").text)
	327	+
	328	+ if self.fixed_for_user(file_elem, user, False):
	329	+ priority.append(file_elem.find("name").text)
	330	+
	331	+ return priority, result
	332	+
	333	+ def for_adjudication(self, user):
	334	+ priority = []
	335	+ result = []
	336	+ for file_elem in self.root:
	337	+ if self.rejected(file_elem):
	338	+ continue
	339	+
	340	+ anns = file_elem.findall("ann")
	341	+ owners = map(lambda ann: ann.find("annName").text, anns)
	342	+ checked = map(lambda ann: ann.find("checkinDate") != None, anns)
	343	+ if (len(owners) == self.anno_per_file
	344	+ and file_elem.find("s_ann") is None
	345	+ and user not in owners
	346	+ and all(checked)):
	347	+ result.append(file_elem.find("name").text)
	348	+
	349	+ if self.fixed_for_user(file_elem, user, True):
	350	+ priority.append(file_elem.find("name").text)
	351	+
	352	+ return priority, result
	353	+
	354	+ def owns_normal(self, user):
	355	+ return [ file_elem.find("name").text
	356	+ for file_elem
	357	+ in self.ann_owned_index[user] ]
	358	+
	359	+ def owns_super(self, user):
	360	+ return [ file_elem.find("name").text
	361	+ for file_elem
	362	+ in self.adj_owned_index[user] ]
	363	+
	364	+ def owns(self, user):
	365	+ return self.owns_normal(user) + self.owns_super(user)
	366	+
	367	+ def finished_count(self, user):
	368	+ n = 0
	369	+ for file_elem in self.root:
	370	+
	371	+ if self.rejected(file_elem):
	372	+ continue
	373	+
	374	+ items = file_elem.findall("ann")
	375	+ items.extend(file_elem.findall("s_ann"))
	376	+ for ann_elem in items:
	377	+ ann_name = ann_elem.find("annName").text
	378	+ if ann_name == user and self.finished(ann_elem) and not self.returned(ann_elem):
	379	+ n += 1
	380	+
	381	+ return n
...	...

gui/dfs/msg/__init__.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/dfs/msg/__init__.py
...	...

gui/dfs/msg/message.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/dfs/msg/message.py
	1	+# -- coding: utf-8 --
	2	+__all__ = ["decode", "Message", "OkMessage", "KoMessage", "DownloadRequest"
	3	+ , "UploadRequest", "DownloadPrimRequest", "ClientDone", "ServerDone"
	4	+ , "NumMessage", "BoolMessage", "ReturnRequest", "CheckoutRequest",
	5	+ "CheckinRequest", "StatsRequest"]
	6	+
	7	+
	8	+class Message(object):
	9	+
	10	+ """
	11	+ Base class for SSL communication messages.
	12	+ """
	13	+
	14	+ def __init__(self, contents=""):
	15	+ self.contents = contents
	16	+
	17	+ def get_contents(self):
	18	+ return self.contents
	19	+
	20	+ @classmethod
	21	+ def from_contents(cls, contents):
	22	+ return cls(contents)
	23	+
	24	+ def encode(self):
	25	+ """
	26	+ Prepare message to be sent over network.
	27	+ WARNING: Do not override this method.
	28	+ """
	29	+ # Add "-" on the beggining to prevent
	30	+ # message contents from being void.
	31	+ return self.msg_type, "-" + self.get_contents()
	32	+
	33	+
	34	+class NumMessage(Message):
	35	+
	36	+ def __init__(self, n):
	37	+ self.number = n
	38	+
	39	+ def get_contents(self):
	40	+ return str(self.number)
	41	+
	42	+ @classmethod
	43	+ def from_contents(cls, contents):
	44	+ return cls(int(contents))
	45	+
	46	+ def get_number(self):
	47	+ return self.number
	48	+
	49	+
	50	+class BoolMessage(Message):
	51	+
	52	+ def __init__(self, b):
	53	+ self.b = b
	54	+
	55	+ def get_contents(self):
	56	+ return "1" if self.b else "0"
	57	+
	58	+ @classmethod
	59	+ def from_contents(cls, contents):
	60	+ return cls(bool(int(contents)))
	61	+
	62	+ def get_boolean(self):
	63	+ return self.b
	64	+
	65	+class ReturnRequest(NumMessage):
	66	+ pass
	67	+
	68	+class CheckoutRequest(Message):
	69	+ pass
	70	+
	71	+class CheckinRequest(NumMessage):
	72	+ pass
	73	+
	74	+class DownloadRequest(NumMessage):
	75	+ pass
	76	+
	77	+class DownloadPrimRequest(NumMessage):
	78	+ pass
	79	+
	80	+class UploadRequest(NumMessage):
	81	+ pass
	82	+
	83	+class OkMessage(Message):
	84	+ pass
	85	+
	86	+class KoMessage(Message):
	87	+ pass
	88	+
	89	+class StatsRequest(Message):
	90	+ pass
	91	+
	92	+class ServerDone(Message):
	93	+ pass
	94	+
	95	+class ClientDone(Message):
	96	+ pass
	97	+
	98	+
	99	+def subclasses(cls):
	100	+ yield cls
	101	+ for child in cls.__subclasses__():
	102	+ for desc in subclasses(child):
	103	+ yield desc
	104	+
	105	+def decode(msg_type, contents):
	106	+ for cls in subclasses(Message):
	107	+ if cls.msg_type == msg_type:
	108	+ # Discard first, dummy character;
	109	+ # Confront Message.encode method.
	110	+ return cls.from_contents(contents[1:])
	111	+
	112	+for i, cls in enumerate(subclasses(Message)):
	113	+ cls.msg_type = i
...	...

gui/dfs/msg/stream.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/dfs/msg/stream.py
	1	+# -- coding: utf-8 --
	2	+import struct
	3	+
	4	+from message import decode
	5	+
	6	+__all__ = ["read_msg", "write_msg", "EndOfStream"]
	7	+
	8	+class EndOfStream(Exception):
	9	+ pass
	10	+
	11	+class BadMessage(Exception):
	12	+ pass
	13	+
	14	+def read_msg(connstream):
	15	+ encoded = read_encoded(connstream)
	16	+ return decode(*encoded)
	17	+
	18	+def accept_msg(connstream, cls):
	19	+ msg = read_msg(connstream)
	20	+ if type(msg) != cls:
	21	+ raise BadMessage("Expected %s, got %s" %
	22	+ (cls.__name__, type(msg).__name__))
	23	+ return msg
	24	+
	25	+def write_msg(connstream, msg):
	26	+ encoded = msg.encode()
	27	+ write_encoded(connstream, *encoded)
	28	+
	29	+def read_encoded(connstream):
	30	+ _type = read_type(connstream)
	31	+ length = read_length(connstream)
	32	+ content = read_content(connstream, length)
	33	+ return _type, content
	34	+
	35	+def write_encoded(connstream, _type, content):
	36	+ write_type(connstream, _type)
	37	+ write_length(connstream, len(content))
	38	+ write_content(connstream, content)
	39	+
	40	+def read_type(connstream):
	41	+ data = read_all(connstream, 1)
	42	+ return struct.unpack("!B", data)[0]
	43	+
	44	+def write_type(connstream, _type):
	45	+ data = struct.pack("!B", _type)
	46	+ write_all(connstream, data)
	47	+
	48	+def read_length(connstream):
	49	+ data = read_all(connstream, 4)
	50	+ return struct.unpack("!L", data)[0]
	51	+
	52	+def write_length(connstream, n):
	53	+ data = struct.pack("!L", n)
	54	+ write_all(connstream, data)
	55	+
	56	+def read_content(connstream, length):
	57	+ return read_all(connstream, length)
	58	+
	59	+def write_content(connstream, content):
	60	+ write_all(connstream, content)
	61	+
	62	+def write_all(connstream, data):
	63	+ k = connstream.write(data)
	64	+ if k != len(data):
	65	+ raise Exception("Did not send all data !")
	66	+
	67	+def read_all(connstream, k):
	68	+ data = ""
	69	+ while k > 0:
	70	+ # part = connstream.read()
	71	+ part = connstream.read(min(k, 1024))
	72	+ if len(part) == 0:
	73	+ raise EndOfStream
	74	+ k -= len(part)
	75	+ # if k < 0:
	76	+ # raise Exception("Received more than expected !")
	77	+ data += part
	78	+ return data
	79	+
...	...

gui/dfs/repo.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/dfs/repo.py
	1	+# -- coding: utf-8 --
	2	+import os
	3	+import shutil
	4	+import pysvn
	5	+
	6	+class Repo:
	7	+
	8	+ def __init__(self, path, login, passwd):
	9	+ self.path = path
	10	+ def get_login(_realm, _username, _may_save):
	11	+ return True, login, passwd, False
	12	+ self.svn = pysvn.Client()
	13	+ self.svn.callback_get_login = get_login
	14	+ self.svn.update(self.path)
	15	+
	16	+ def add(self, src_path):
	17	+ part_name = os.path.basename(src_path)
	18	+ dest_path = os.path.join(self.new_path(), part_name)
	19	+
	20	+ if (not self.svn.info(dest_path) is None) or (os.path.exists(dest_path)):
	21	+ raise Exception(src_path+" already present in repository.")
	22	+
	23	+ shutil.copy(src_path, dest_path)
	24	+ self.svn.add(dest_path)
	25	+
	26	+ def remove(self, filename, anno_per_file):
	27	+ paths = set()
	28	+ paths.add(os.path.join(self.new_path(), filename))
	29	+ for i in range(anno_per_file):
	30	+ paths.add(self.upload_path(filename, i))
	31	+ paths.add(os.path.join(self.finito_path(), filename))
	32	+
	33	+ removed = []
	34	+ for path in paths:
	35	+ if os.path.exists(path):
	36	+ self.svn.remove(path)
	37	+ removed.append(path)
	38	+
	39	+ return removed
	40	+
	41	+ def db_path(self):
	42	+ return os.path.join(self.path, "db.xml")
	43	+
	44	+ def new_path(self):
	45	+ return os.path.join(self.path, "new")
	46	+
	47	+ def ann_path(self, idx):
	48	+ ids = chr(idx+ord('A'))
	49	+ tail = os.path.join("annotation", ids)
	50	+ return os.path.join(self.path, tail)
	51	+
	52	+ def finito_path(self):
	53	+ return os.path.join(self.path, "adjudication")
	54	+
	55	+ def upload_path(self, file_name, idx):
	56	+ return os.path.join(self.ann_path(idx), file_name)
	57	+
	58	+ def upload_prim_path(self, file_name):
	59	+ return os.path.join(self.finito_path(), file_name)
	60	+
	61	+ def read_data(self, path):
	62	+ with open(path) as src:
	63	+ return src.read()
	64	+
	65	+ def read_contents(self, path, exts):
	66	+ contents = {}
	67	+ for ext in exts:
	68	+ contents[ext] = self.read_data(path + ext)
	69	+ return contents
	70	+
	71	+ def write_data(self, path, data):
	72	+ with open(path, "w") as dest:
	73	+ dest.write(data)
	74	+
	75	+ def write_contents(self, path, contents):
	76	+ for ext, data in contents.iteritems():
	77	+ dest_path = path + ext
	78	+ self.write_data(dest_path, data)
	79	+ if self.svn.info(dest_path) is None:
	80	+ self.svn.add(dest_path)
	81	+
	82	+ def upload(self, file_id, idx, contents):
	83	+ self.write_contents(self.upload_path(file_id, idx), contents)
	84	+
	85	+ def upload_prim(self, file_id, contents):
	86	+ self.write_contents(self.upload_prim_path(file_id), contents)
	87	+
	88	+ def download(self, file_id, exts):
	89	+ return self.read_contents(os.path.join(self.new_path(), file_id), exts)
	90	+
	91	+ def download_prim(self, file_id, exts, anno_per_file):
	92	+ result = []
	93	+ for i in range(anno_per_file):
	94	+ conts = self.read_contents(os.path.join(self.ann_path(i), file_id), exts)
	95	+ result.append(conts)
	96	+ return result
	97	+
	98	+ def checkout(self, file_id, idx, exts):
	99	+ src_paths = [ self.upload_path(file_id, idx)
	100	+ , os.path.join(self.new_path(), file_id) ]
	101	+ for path in src_paths:
	102	+ if all(os.path.exists(path + ext) for ext in exts):
	103	+ return self.read_contents(path, exts)
	104	+
	105	+ def checkout_prim(self, file_id, exts):
	106	+ path = os.path.join(self.finito_path(), file_id)
	107	+ if all(os.path.exists(path + ext) for ext in exts):
	108	+ return self.read_contents(path, exts)
	109	+
	110	+ def commit(self, message):
	111	+ self.svn.checkin(self.path, message, recurse=True)
	112	+
	113	+ def revert(self):
	114	+ self.svn.revert(self.path, recurse=True)
...	...

gui/dfs/server.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/dfs/server.py
	1	+# -- coding: utf-8 --
	2	+import sys
	3	+import os
	4	+import traceback
	5	+import socket, ssl
	6	+import random
	7	+from optparse import OptionParser
	8	+import signal
	9	+
	10	+from utils import validate_user, UserInvalid, send_contents, receive_contents
	11	+from msg.stream import read_msg, write_msg, accept_msg, EndOfStream, BadMessage
	12	+from msg.message import *
	13	+from repo import Repo
	14	+from database import Database
	15	+from config import Config
	16	+
	17	+class SSLServer:
	18	+
	19	+ def __init__(self, host, port, backlog, cert_file, key_file,
	20	+ repository, svn_login, svn_passwd, pass_file,
	21	+ users_file, file_exts, anno_per_file, log=None):
	22	+ """
	23	+ Initialize SSL server.
	24	+
	25	+ params:
	26	+ =======
	27	+ host : str
	28	+ Host name.
	29	+ port : int
	30	+ Port number.
	31	+ backlog : int
	32	+ Maximum number of waiting connections.
	33	+ cert_file : path
	34	+ Public PEM certificate.
	35	+ key_file : path
	36	+ Private key.
	37	+ pass_file : path
	38	+ File with client passwords.
	39	+ users_file : path
	40	+ File with additional users configuration.
	41	+ repository : path
	42	+ Subversion working copy.
	43	+ svn_login : str
	44	+ Subversion login.
	45	+ svn_passwd : str
	46	+ Subversion password.
	47	+ file_exts : [str]
	48	+ List of file extensions.
	49	+ anno_per_file : int
	50	+ Number of normal annotators per file (1 or 2)
	51	+ """
	52	+ self.cert_file = cert_file
	53	+ self.key_file = key_file
	54	+ self.pass_file = pass_file
	55	+ self.users_file = users_file
	56	+ self.wc = Repo(repository, svn_login, svn_passwd)
	57	+ self.file_exts = file_exts
	58	+ if log is not None:
	59	+ self.log = open(log, "a")
	60	+ else:
	61	+ self.log = sys.stdout
	62	+ self.bound = bind_socket(host, port, backlog=backlog)
	63	+ self.serving = None
	64	+ self.anno_per_file = anno_per_file
	65	+
	66	+ def run(self):
	67	+ while True:
	68	+ newsocket, fromaddr = self.bound.accept()
	69	+ self.serving = fromaddr
	70	+ connstream = None
	71	+ try:
	72	+ connstream = ssl.wrap_socket(newsocket,
	73	+ server_side=True,
	74	+ certfile=self.cert_file,
	75	+ keyfile=self.key_file,
	76	+ ssl_version=ssl.PROTOCOL_TLSv1)
	77	+
	78	+ login = validate_user(connstream, self.pass_file)
	79	+ self.serve_client(connstream, login)
	80	+ except UserInvalid as login:
	81	+ print >> self.log, "AUTH ERROR:", login
	82	+ except BadMessage as info:
	83	+ print >> self.log, "BAD MESSAGE ERROR:", info
	84	+ print >> self.log, traceback.format_exc().strip()
	85	+ except EndOfStream:
	86	+ print >> self.log, "UNEXPECTED END OF STREAM:"
	87	+ print >> self.log, traceback.format_exc().strip()
	88	+ except:
	89	+ print >> self.log, "UNEXPECTED ERROR:"
	90	+ print >> self.log, traceback.format_exc().strip()
	91	+ finally:
	92	+ try:
	93	+ if not connstream is None:
	94	+ connstream.shutdown(socket.SHUT_RDWR)
	95	+ except:
	96	+ print >> self.log, "UNEXPECTED ERROR:"
	97	+ print >> self.log, traceback.format_exc().strip()
	98	+ finally:
	99	+ if not connstream is None:
	100	+ connstream.close()
	101	+ self.serving = None
	102	+
	103	+ def exit(self):
	104	+ if self.serving is not None:
	105	+ print ("Client from %s connected to the server"
	106	+ % str(self.serving))
	107	+ else:
	108	+ sys.exit(0)
	109	+
	110	+ def process_msg(self, msg, stream, login):
	111	+ if type(msg) == UploadRequest:
	112	+ self.process_upload_msg(msg, stream, login, checkin=False)
	113	+ elif type(msg) == CheckinRequest:
	114	+ self.process_upload_msg(msg, stream, login, checkin=True)
	115	+ elif type(msg) == CheckoutRequest:
	116	+ self.process_checkout_msg(msg, stream, login)
	117	+ elif type(msg) == DownloadRequest:
	118	+ self.process_download_msg(msg, stream, login)
	119	+ elif type(msg) == DownloadPrimRequest:
	120	+ self.process_download_prim_msg(msg, stream, login)
	121	+ elif type(msg) == ReturnRequest:
	122	+ self.process_return_msg(msg, stream, login)
	123	+ elif type(msg) == StatsRequest:
	124	+ self.process_stats_msg(msg, stream, login)
	125	+ else:
	126	+ print >> self.log, login, "sent:", msg
	127	+
	128	+ def process_return_msg(self, msg, stream, login):
	129	+ reason = accept_msg(stream, Message).get_contents().decode("utf-8")
	130	+
	131	+ usr_cfg = Config(self.users_file)
	132	+ try:
	133	+ user_adj = login in usr_cfg["auth.adjudicators"].split()
	134	+ except KeyError:
	135	+ user_adj = False
	136	+
	137	+ db = Database(self.wc.db_path(), self.anno_per_file)
	138	+ n = msg.get_number()
	139	+ for _ in range(n):
	140	+ file_id = accept_msg(stream, Message).get_contents()
	141	+ is_adj = accept_msg(stream, BoolMessage).get_boolean()
	142	+ if is_adj and not user_adj:
	143	+ write_msg(stream, KoMessage())
	144	+ print >> self.log, "Upload error - user " + login + " tried to upload super annotated file " + file_id + " but is not a super annotator"
	145	+ continue
	146	+ else:
	147	+ error = db.upload_prevention(file_id, login, is_adj)
	148	+ if error is not None:
	149	+ write_msg(stream, KoMessage())
	150	+ print >> self.log, "Upload error by user " + login + ". Details: "+error
	151	+ continue
	152	+
	153	+ write_msg(stream, OkMessage())
	154	+ contents = receive_contents(stream)
	155	+ for key in contents.keys():
	156	+ if key not in self.file_exts:
	157	+ print >> self.log, "Skipped file uploaded by user " + login + ". Filename:"+file_id+key
	158	+ del contents[key]
	159	+
	160	+ if is_adj is False:
	161	+ idx = db.return_file(file_id, login, reason)
	162	+ self.wc.upload(file_id, idx, contents)
	163	+ else:
	164	+ db.return_file_prim(file_id, login, reason)
	165	+ self.wc.upload_prim(file_id, contents)
	166	+
	167	+ db.save()
	168	+ accept_msg(stream, ClientDone)
	169	+ self.wc.commit("return request from %s"
	170	+ % (login))
	171	+ write_msg(stream, ServerDone())
	172	+
	173	+
	174	+ def process_upload_msg(self, msg, stream, login, checkin=False):
	175	+ usr_cfg = Config(self.users_file)
	176	+ try:
	177	+ user_adj = login in usr_cfg["auth.adjudicators"].split()
	178	+ except KeyError:
	179	+ user_adj = False
	180	+
	181	+ db = Database(self.wc.db_path(), self.anno_per_file)
	182	+ n = msg.get_number()
	183	+ for _ in range(n):
	184	+ file_id = accept_msg(stream, Message).get_contents()
	185	+ is_adj = accept_msg(stream, BoolMessage).get_boolean()
	186	+ if is_adj and not user_adj:
	187	+ write_msg(stream, KoMessage())
	188	+ print >> self.log, "Upload error - user " + login + " tried to upload super annotated file " + file_id + " but is not a super annotator"
	189	+ continue
	190	+ else:
	191	+ error = db.upload_prevention(file_id, login, is_adj)
	192	+ if error is not None:
	193	+ write_msg(stream, KoMessage())
	194	+ print >> self.log, "Upload error by user " + login + ". Details: "+error
	195	+ continue
	196	+
	197	+ write_msg(stream, OkMessage())
	198	+ contents = receive_contents(stream)
	199	+ for key in contents.keys():
	200	+ if key not in self.file_exts:
	201	+ print >> self.log, "Skipped file uploaded by user " + login + ". Filename:"+file_id+key
	202	+ del contents[key]
	203	+
	204	+ if is_adj is False:
	205	+ if checkin:
	206	+ idx = db.upload(file_id, login)
	207	+ else:
	208	+ idx = db.upload_id(file_id, login)
	209	+ self.wc.upload(file_id, idx, contents)
	210	+ else:
	211	+ if checkin:
	212	+ db.upload_prim(file_id, login)
	213	+ self.wc.upload_prim(file_id, contents)
	214	+
	215	+ if checkin:
	216	+ db.save()
	217	+ accept_msg(stream, ClientDone)
	218	+ self.wc.commit("%s request from %s"
	219	+ % ("checkin" if checkin else "upload", login))
	220	+ write_msg(stream, ServerDone())
	221	+
	222	+ def process_checkout_msg(self, msg, stream, login):
	223	+ db = Database(self.wc.db_path(), self.anno_per_file)
	224	+
	225	+ ann_files = db.owns_normal(login)
	226	+ write_msg(stream, NumMessage(len(ann_files)))
	227	+ for file_id in ann_files:
	228	+ write_msg(stream, Message(file_id))
	229	+ idx = db.upload_id(file_id, login)
	230	+ contents = self.wc.checkout(file_id, idx, self.file_exts)
	231	+ send_contents(stream, contents)
	232	+
	233	+ adj_files = db.owns_super(login)
	234	+ write_msg(stream, NumMessage(len(adj_files)))
	235	+ write_msg(stream, NumMessage(self.anno_per_file))
	236	+ for file_id in adj_files:
	237	+ write_msg(stream, Message(file_id))
	238	+
	239	+ contents = self.wc.download_prim(file_id, self.file_exts, self.anno_per_file)
	240	+ for conts in contents:
	241	+ send_contents(stream, conts)
	242	+
	243	+ conts3 = self.wc.checkout_prim(file_id, self.file_exts)
	244	+ if conts3 is None:
	245	+ write_msg(stream, BoolMessage(False))
	246	+ else:
	247	+ write_msg(stream, BoolMessage(True))
	248	+ send_contents(stream, conts3)
	249	+
	250	+ accept_msg(stream, ClientDone)
	251	+ #self.wc.commit("checkout request from %s" % login)
	252	+ write_msg(stream, ServerDone())
	253	+
	254	+ def process_stats_msg(self, msg, stream, login):
	255	+ usr_cfg = Config(self.users_file)
	256	+ db = Database(self.wc.db_path(), self.anno_per_file)
	257	+
	258	+ write_msg(stream, NumMessage(db.finished_count(login)))
	259	+
	260	+ accept_msg(stream, ClientDone)
	261	+ write_msg(stream, ServerDone())
	262	+
	263	+ def process_download_msg(self, msg, stream, login):
	264	+ usr_cfg = Config(self.users_file)
	265	+ db = Database(self.wc.db_path(), self.anno_per_file)
	266	+
	267	+ down_num = msg.get_number()
	268	+ owns_num = len(db.owns_normal(login))
	269	+ limit = float('inf')
	270	+ try:
	271	+ limit = int(usr_cfg["limits.%s.annotation" % login])
	272	+ except KeyError:
	273	+ limit = int(usr_cfg["limits.annotation"])
	274	+ if down_num + owns_num > limit:
	275	+ down_num = max(0, limit - owns_num)
	276	+
	277	+ for_ann_fixed, for_ann = db.for_annotation(login)
	278	+ if len(for_ann) + len(for_ann_fixed) == 0:
	279	+ print >> self.log, "User " + login + " has no more files to download for annotation."
	280	+
	281	+ down_files = sample(for_ann_fixed, down_num)
	282	+ down_num = max(0, down_num - len(down_files))
	283	+ down_files = down_files + sample(for_ann, down_num)
	284	+
	285	+ write_msg(stream, NumMessage(len(down_files)))
	286	+
	287	+ for file_id in down_files:
	288	+ fixed_idx = db.download(file_id, login)
	289	+ write_msg(stream, Message(file_id))
	290	+ if fixed_idx is None:
	291	+ contents = self.wc.download(file_id, self.file_exts)
	292	+ else:
	293	+ contents = self.wc.checkout(file_id, fixed_idx, self.file_exts)
	294	+ send_contents(stream, contents)
	295	+ db.save()
	296	+ accept_msg(stream, ClientDone)
	297	+ self.wc.commit("download request from %s" % login)
	298	+ write_msg(stream, ServerDone())
	299	+
	300	+ def process_download_prim_msg(self, msg, stream, login):
	301	+ usr_cfg = Config(self.users_file)
	302	+ try:
	303	+ adjudicators = usr_cfg["auth.adjudicators"].split()
	304	+ except KeyError:
	305	+ adjudicators = []
	306	+ if login in adjudicators:
	307	+ write_msg(stream, OkMessage())
	308	+ else:
	309	+ write_msg(stream, KoMessage())
	310	+ return
	311	+ db = Database(self.wc.db_path(), self.anno_per_file)
	312	+
	313	+ down_num = msg.get_number()
	314	+ owns_num = len(db.owns_super(login))
	315	+ limit = float('inf')
	316	+ try:
	317	+ limit = int(usr_cfg["limits.%s.adjudication" % login])
	318	+ except KeyError:
	319	+ limit = int(usr_cfg["limits.adjudication"])
	320	+ if down_num + owns_num > limit:
	321	+ down_num = max(0, limit - owns_num)
	322	+
	323	+ for_adj_fixed, for_adj = db.for_adjudication(login)
	324	+ if len(for_adj) + len(for_adj_fixed) == 0:
	325	+ print >> self.log, "User " + login + " has no more files to download for superannotation."
	326	+
	327	+ down_files = sample(for_adj_fixed, down_num)
	328	+ down_num = max(0, down_num - len(down_files))
	329	+ down_files = down_files + sample(for_adj, down_num)
	330	+
	331	+ write_msg(stream, NumMessage(len(down_files)))
	332	+ write_msg(stream, NumMessage(self.anno_per_file))
	333	+ for file_id in down_files:
	334	+ write_msg(stream, Message(file_id))
	335	+ fixed = db.download_prim(file_id, login)
	336	+
	337	+ contents = self.wc.download_prim(file_id, self.file_exts, self.anno_per_file)
	338	+ for conts in contents:
	339	+ send_contents(stream, conts)
	340	+
	341	+ if fixed:
	342	+ write_msg(stream, BoolMessage(True))
	343	+ contents = self.wc.checkout_prim(file_id, self.file_exts)
	344	+ send_contents(stream, contents)
	345	+ else:
	346	+ write_msg(stream, BoolMessage(False))
	347	+
	348	+ db.save()
	349	+ accept_msg(stream, ClientDone)
	350	+ self.wc.commit("download' request from %s" % login)
	351	+ write_msg(stream, ServerDone())
	352	+
	353	+ def serve_client(self, connstream, login):
	354	+ msg = read_msg(connstream)
	355	+ try:
	356	+ self.process_msg(msg, connstream, login)
	357	+ except:
	358	+ self.wc.revert()
	359	+ raise
	360	+
	361	+def bind_socket(host, port, backlog=5):
	362	+ bound = socket.socket()
	363	+ bound.bind((host, port))
	364	+ bound.listen(backlog)
	365	+ return bound
	366	+
	367	+def sample(population, n):
	368	+ if len(population) > n:
	369	+ return random.sample(population, n)
	370	+ else:
	371	+ return population
	372	+
	373	+if __name__ == "__main__":
	374	+ optparser = OptionParser(usage="""usage: %prog CONFIG""")
	375	+ (options, args) = optparser.parse_args()
	376	+ if len(args) != 1:
	377	+ optparser.print_help()
	378	+ sys.exit(0)
	379	+
	380	+ cfg = Config(args[0])
	381	+ server = SSLServer(
	382	+ host=cfg["connection.host"],
	383	+ port=int(cfg["connection.port"]),
	384	+ backlog=int(cfg["connection.backlog"]),
	385	+ cert_file=cfg["connection.certfile"],
	386	+ key_file=cfg["connection.keyfile"],
	387	+ repository=cfg["svn.repository"],
	388	+ svn_login=cfg["svn.login"],
	389	+ svn_passwd=cfg["svn.passwd"],
	390	+ pass_file=cfg["users.passfile"],
	391	+ users_file=cfg["users.config"],
	392	+ file_exts=cfg["file_extensions"].split(),
	393	+ anno_per_file=int(cfg["anno_per_file"])
	394	+ )
	395	+
	396	+ def handler(signum, frame):
	397	+ server.exit()
	398	+
	399	+ signal.signal(signal.SIGINT, handler)
	400	+
	401	+ server.run()
...	...

gui/dfs/utils.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/dfs/utils.py
	1	+# -- coding: utf-8 --
	2	+import hashlib
	3	+
	4	+from msg.stream import accept_msg, write_msg
	5	+from msg.message import Message, OkMessage, KoMessage, NumMessage
	6	+
	7	+class UserInvalid(Exception):
	8	+ pass
	9	+
	10	+def validate_user(conns, pass_file):
	11	+ pass_dict = parse_passwd(pass_file)
	12	+ login = accept_msg(conns, Message).get_contents()
	13	+ passwd = accept_msg(conns, Message).get_contents()
	14	+ if pass_dict.has_key(login) and pass_dict[login] == passwd:
	15	+ write_msg(conns, OkMessage())
	16	+ return login
	17	+ else:
	18	+ write_msg(conns, KoMessage())
	19	+ raise UserInvalid(login)
	20	+
	21	+def parse_passwd(pass_file):
	22	+ result = {}
	23	+ with open(pass_file) as f:
	24	+ for line in f:
	25	+ login, passwd = line.split("=")
	26	+ login = login.strip()
	27	+ passwd = passwd.strip()
	28	+ result[login] = passwd
	29	+ return result
	30	+
	31	+def _check_sum(*args):
	32	+ m = hashlib.sha256()
	33	+ for arg in args:
	34	+ m.update(arg)
	35	+ return m
	36	+
	37	+def check_sum(*args):
	38	+ return _check_sum(*args).digest()
	39	+
	40	+def check_hexsum(*args):
	41	+ return _check_sum(*args).hexdigest()
	42	+
	43	+def send_contents(stream, contents):
	44	+ write_msg(stream, NumMessage(len(contents)))
	45	+ for ext, data in contents.iteritems():
	46	+ write_msg(stream, Message(ext))
	47	+ write_msg(stream, Message(data))
	48	+ write_msg(stream, Message(check_sum(ext, data)))
	49	+ accept_msg(stream, OkMessage)
	50	+
	51	+def receive_contents(stream):
	52	+ contents = {}
	53	+ n = accept_msg(stream, NumMessage).get_number()
	54	+ for _ in range(n):
	55	+ ext = accept_msg(stream, Message).get_contents()
	56	+ data = accept_msg(stream, Message).get_contents()
	57	+ csum = accept_msg(stream, Message).get_contents()
	58	+ if csum == check_sum(ext, data):
	59	+ write_msg(stream, OkMessage())
	60	+ else:
	61	+ write_msg(stream, KoMessage())
	62	+ contents[ext] = data
	63	+ return contents
...	...

gui/dir_cache.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/dir_cache.py
	1	+# -- coding: utf-8 --
	2	+"""Directory cache manipulation"""
	3	+
	4	+import os
	5	+
	6	+class DirCache:
	7	+
	8	+ def __init__(self, path, size):
	9	+ if not os.path.exists(path):
	10	+ with open(path, "w") as f: pass
	11	+ self.path = path
	12	+ self.size = size
	13	+
	14	+ def add(self, dir_name):
	15	+ cache = self.get()
	16	+ if dir_name in cache:
	17	+ cache.remove(dir_name)
	18	+ cache.insert(0, dir_name)
	19	+ self.write(cache[:self.size])
	20	+
	21	+ def get(self):
	22	+ with open(self.path) as f:
	23	+ return [x.strip() for x in f.readlines()]
	24	+
	25	+ def write(self, cache):
	26	+ with open(self.path, "w") as f:
	27	+ for entry in cache:
	28	+ print >> f, entry
...	...

gui/footprints.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/footprints.py
	1	+# -- coding: utf-8 --
	2	+import os
	3	+import copy
	4	+
	5	+# from dfs.utils import check_hexsum as check_sum
	6	+
	7	+def getmtime(path):
	8	+ return round(os.path.getmtime(path))
	9	+
	10	+from utils import all_files
	11	+
	12	+class FootPrints:
	13	+
	14	+ """Class for footprints file manipulation."""
	15	+
	16	+ def __init__(self, prints_path, dir_path, exts):
	17	+ self.prints_path = prints_path
	18	+ self.dir_path = dir_path
	19	+ self.exts = exts
	20	+ if not os.path.exists(prints_path):
	21	+ with open(prints_path, "w") as f: pass
	22	+ self.prints = self.read()
	23	+ self.backup = copy.deepcopy(self.prints)
	24	+
	25	+ def modified(self, name):
	26	+ try:
	27	+ # (mtime, csum) = self.get_print(name)
	28	+ mtime = self.get_print(name)
	29	+ except KeyError:
	30	+ return False
	31	+
	32	+ path = os.path.join(self.dir_path, name)
	33	+ if mtime != self.print_now(path):
	34	+ return True
	35	+ return False
	36	+
	37	+ """ sprawdza czy nie pojawily sie jakies nowe pliki, ewentualnie dodajac dla nich wpisy """
	38	+ def refresh(self):
	39	+ old_prints = self.prints
	40	+ new_prints = {}
	41	+ for name in all_files(self.dir_path, self.exts):
	42	+ if old_prints.has_key(name):
	43	+ new_prints[name] = old_prints[name]
	44	+ else:
	45	+ path = os.path.join(self.dir_path, name)
	46	+ new_prints[name] = self.print_now(path)
	47	+ self.prints = new_prints
	48	+
	49	+ def renew(self, name):
	50	+ path = os.path.join(self.dir_path, name)
	51	+ try:
	52	+ self.prints[name] = self.print_now(path)
	53	+ except:
	54	+ del self.prints[name]
	55	+ print "Footprints: "+ path + " file not found."
	56	+
	57	+ def renew_all(self):
	58	+ for key in self.prints.keys():
	59	+ self.renew(key)
	60	+
	61	+ def get_print(self, name):
	62	+ path = os.path.join(self.dir_path, name)
	63	+ return self.prints[name]
	64	+
	65	+ def print_now(self, path):
	66	+ return max(getmtime(path + ext) for ext in self.exts)
	67	+
	68	+ def read(self):
	69	+ prints = {}
	70	+ with open(self.prints_path) as f:
	71	+ for line in f:
	72	+ key, mtime = line.split()
	73	+ prints[key] = float(mtime)
	74	+ return prints
	75	+
	76	+ def write(self):
	77	+ with open(self.prints_path, "w") as f:
	78	+ # for key, (mtime, csum) in sorted(self.prints.items()):
	79	+ # print >> f, key, "=", mtime, csum
	80	+ for key, mtime in sorted(self.prints.items()):
	81	+ print >> f, key, mtime
	82	+
	83	+ def save(self):
	84	+ if self.prints != self.backup:
	85	+ self.write()
...	...

gui/i18n.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/i18n.py
	1	+# -- coding: utf-8 --
	2	+import os, sys
	3	+import locale
	4	+import gettext
	5	+import const
	6	+
	7	+def get_path():
	8	+ '''Get the path to this script no matter how it's run.'''
	9	+ #Determine if the application is a py/pyw or a frozen exe.
	10	+ if hasattr(sys, 'frozen'):
	11	+ # If run from exe
	12	+ dir_path = os.path.dirname(sys.executable)
	13	+ elif '__file__' in locals():
	14	+ # If run from py
	15	+ dir_path = os.path.dirname(__file__)
	16	+ else:
	17	+ # If run from command line
	18	+ dir_path = sys.path[0]
	19	+ return dir_path
	20	+
	21	+
	22	+# Change this variable to your app name!
	23	+# The translation files will be under
	24	+# @LOCALE_DIR@/@LANGUAGE@/LC_MESSAGES/@APP_NAME@.mo
	25	+#
	26	+APP_NAME = "manager"
	27	+# This is ok for maemo. Not sure in a regular desktop:
	28	+APP_DIR = get_path()
	29	+LOCALE_DIR = os.path.join(APP_DIR, 'po')
	30	+
	31	+langs = ["pl"]
	32	+if (const.lang == "en"):
	33	+ langs = ["en"]
	34	+
	35	+# Lets tell those details to gettext
	36	+gettext.install (True)
	37	+gettext.bindtextdomain (APP_NAME,
	38	+ LOCALE_DIR)
	39	+gettext.textdomain (APP_NAME)
	40	+language = gettext.translation (APP_NAME,
	41	+ LOCALE_DIR,
	42	+ languages = langs,
	43	+ fallback = False)
	44	+
	45	+
0	46	\ No newline at end of file
...	...

gui/img/down.png 0 → 100644

View file @44cbbee

846 Bytes

gui/img/ready.png 0 → 100644

View file @44cbbee

849 Bytes

gui/img/textimg_1.png 0 → 100644

View file @44cbbee

522 Bytes

gui/img/textimg_2.png 0 → 100644

View file @44cbbee

648 Bytes

gui/img/textimg_3.png 0 → 100644

View file @44cbbee

782 Bytes

gui/img/up.png 0 → 100644

View file @44cbbee

837 Bytes

gui/log_thread.py 0 → 100644

View file @44cbbee

	1	+++ a/gui/log_thread.py
	1	+# -- coding: utf-8 --
	2	+import wx
	3	+from Queue import Queue
	4	+from threading import Thread
	5	+import copy
	6	+
	7	+class RThread(Thread):
	8	+
	9	+ def __init__(self, target, args, kwargs):
	10	+ self.target = target
	11	+ self.args = args
	12	+ self.kwargs = kwargs
	13	+ self.result = None
	14	+ Thread.__init__(self)
	15	+
	16	+ def run(self):
	17	+ self.result = self.target(self.args, *self.kwargs)
	18	+
	19	+class LogThread(Thread):
	20	+
	21	+ def __init__(self, text_ctrl, target, on_end=None, args=(), kwargs={}):
	22	+ self.text_ctrl = text_ctrl
	23	+ self.target = target
	24	+ self.on_end = on_end
	25	+ self.args = args
	26	+ self.kwargs = kwargs
	27	+ Thread.__init__(self)
	28	+
	29	+ def run(self):
	30	+ queue = Queue()
	31	+ kwargs = copy.copy(self.kwargs)
	32	+ kwargs["log"] = queue
	33	+ worker = RThread( target=self.target
	34	+ , args=self.args
	35	+ , kwargs=kwargs )
	36	+ worker.start()
	37	+ while True:
	38	+ msg = queue.get()
	39	+ if msg is None:
	40	+ break
	41	+ wx.CallAfter(self.print_msg, msg)
	42	+ worker.join()
	43	+
	44	+ if self.on_end:
	45	+ wx.CallAfter(self.on_end, worker.result)
	46	+
	47	+ def print_msg(self, msg):
	48	+ self.text_ctrl.AppendText(msg)
...	...

gui/manager.py 0 → 100755

View file @44cbbee

	1	+++ a/gui/manager.py
	1	+#!/usr/bin/env python
	2	+# -- coding: utf-8 --
	3	+# generated by wxGlade 0.6.3 on Tue Sep 27 12:15:56 2011
	4	+
	5	+import os
	6	+import wx
	7	+
	8	+import i18n
	9	+_ = i18n.language.ugettext #use ugettext instead of getttext to avoid unicode errors
	10	+
	11	+from dfs.config import Config
	12	+from client import run_upload, run_download, run_download_prim, run_checkout, run_return, run_check_stats
	13	+
	14	+from MainFrame import MainFrame
	15	+import utils
	16	+import const
	17	+from ready import Ready
	18	+from dir_cache import DirCache
	19	+from log_thread import LogThread
	20	+from footprints import FootPrints
	21	+
	22	+class FileManager(wx.App):
	23	+
	24	+ def OnInit(self):
	25	+ wx.InitAllImageHandlers()
	26	+ self.main_frame = MainFrame(None, -1, "")
	27	+ self.SetTopWindow(self.main_frame)
	28	+ self.main_frame.Show()
	29	+
	30	+ # Custom code
	31	+ self.main_frame.set_manager(self)
	32	+
	33	+ self.curr_dir = None
	34	+ self.config = None
	35	+ self.selection = None
	36	+ self.connected = False
	37	+ self.dir_cache = DirCache(const.dir_cache_name, size=5)
	38	+ self.refresh_thread = utils.RefreshThread(self, delay=2)
	39	+ self.refresh_thread.start()
	40	+
	41	+ utils.fill_dir_menu(self.main_frame, self.dir_cache.get())
	42	+ # End custom code
	43	+
	44	+ return 1
	45	+
	46	+ def reconf_directory(self):
	47	+ if not self.curr_dir:
	48	+ return
	49	+ config_path = const.path(self.curr_dir, const.config_name)
	50	+ if utils.create_dir_config( config_path, self.main_frame
	51	+ , config=self.config ):
	52	+ self.config = Config(config_path)
	53	+ self.refresh()
	54	+
	55	+ def set_directory(self, path):
	56	+ config_path = const.path(path, const.config_name)
	57	+ if not os.path.exists(config_path):
	58	+ if not utils.create_dir_config(config_path, self.main_frame):
	59	+ return
	60	+ self.config = Config(config_path)
	61	+ self.ready = Ready(const.path(path, const.ready_name))
	62	+ self.curr_dir = path
	63	+ self.dir_cache.add(path)
	64	+ self.main_frame.SetTitle(path)
	65	+ self.refresh()
	66	+
	67	+ def begin_conn(self):
	68	+ if not self.curr_dir:
	69	+ wx.MessageBox(_('Directory not set'), _('Info'))
	70	+ return False
	71	+ if self.connected:
	72	+ wx.MessageBox(_('Another operation running'), _('Info'))
	73	+ return False
	74	+ self.connected = True
	75	+ return True
	76	+
	77	+ def end_conn(self, op_result):
	78	+ self.connected = False
	79	+
	80	+ def upload(self, files, checkin=False):
	81	+ if not self.begin_conn():
	82	+ return
	83	+
	84	+ def on_end(result):
	85	+ self.end_conn(result)
	86	+ if checkin:
	87	+ return
	88	+ if result == True:
	89	+ prints = self.footprints()
	90	+ for file_name in files:
	91	+ prints.renew(file_name)
	92	+ prints.save()
	93	+
	94	+ logger = LogThread( text_ctrl=self.main_frame.log_ctrl
	95	+ , target=run_upload
	96	+ , args=( self.config["login"]
	97	+ , self.config["passwd"]
	98	+ , const.conn_host
	99	+ , const.conn_port
	100	+ , const.conn_cert
	101	+ , files
	102	+ , self.curr_dir
	103	+ , self.config["extensions"].split()
	104	+ , checkin )
	105	+ , on_end=on_end )
	106	+ logger.start()
	107	+
	108	+ def download(self, n):
	109	+ if not self.begin_conn():
	110	+ return
	111	+ logger = LogThread( text_ctrl=self.main_frame.log_ctrl
	112	+ , target=run_download
	113	+ , args=( self.config["login"]
	114	+ , self.config["passwd"]
	115	+ , const.conn_host
	116	+ , const.conn_port
	117	+ , const.conn_cert
	118	+ , n
	119	+ , self.curr_dir )
	120	+ , on_end=self.end_conn )
	121	+ logger.start()
	122	+
	123	+ def download_prim(self, n):
	124	+ if not self.begin_conn():
	125	+ return
	126	+ logger = LogThread( text_ctrl=self.main_frame.log_ctrl
	127	+ , target=run_download_prim
	128	+ , args=( self.config["login"]
	129	+ , self.config["passwd"]
	130	+ , const.conn_host
	131	+ , const.conn_port
	132	+ , const.conn_cert
	133	+ , n
	134	+ , self.curr_dir )
	135	+ , on_end=self.end_conn )
	136	+ logger.start()
	137	+
	138	+ def checkout(self):
	139	+ if not self.begin_conn():
	140	+ return
	141	+
	142	+ def on_end(result):
	143	+ self.end_conn(result)
	144	+ if result == True:
	145	+ prints = self.footprints()
	146	+ files_before = prints.prints.keys()
	147	+ prints.renew_all()
	148	+ prints.save()
	149	+
	150	+
	151	+ logger = LogThread( text_ctrl=self.main_frame.log_ctrl
	152	+ , target=run_checkout
	153	+ , args=( self.config["login"]
	154	+ , self.config["passwd"]
	155	+ , const.conn_host
	156	+ , const.conn_port
	157	+ , const.conn_cert
	158	+ , self.curr_dir
	159	+ , self.config["extensions"].split() )
	160	+ , on_end=on_end )
	161	+ logger.start()
	162	+
	163	+ def return_files(self, files, reason):
	164	+ if not self.begin_conn():
	165	+ return
	166	+
	167	+ def on_end(result):
	168	+ self.end_conn(result)
	169	+
	170	+ logger = LogThread( text_ctrl=self.main_frame.log_ctrl
	171	+ , target=run_return
	172	+ , args=( self.config["login"]
	173	+ , self.config["passwd"]
	174	+ , const.conn_host
	175	+ , const.conn_port
	176	+ , const.conn_cert
	177	+ , files
	178	+ , reason
	179	+ , self.curr_dir
	180	+ , self.config["extensions"].split()
	181	+ )
	182	+ , on_end=on_end )
	183	+ logger.start()
	184	+
	185	+ def footprints(self):
	186	+ return FootPrints( const.path(self.curr_dir, const.footprints_name)
	187	+ , self.curr_dir
	188	+ , self.config["extensions"].split() )
	189	+
	190	+ def refresh(self):
	191	+ if self.curr_dir is None:
	192	+ return
	193	+
	194	+ ready = self.ready.get_entries()
	195	+ extensions = self.config["extensions"].split()
	196	+
	197	+ footprints = self.footprints()
	198	+ footprints.refresh()
	199	+
	200	+ data = utils.normal_entries(
	201	+ self.curr_dir,
	202	+ extensions,
	203	+ ready,
	204	+ footprints)
	205	+
	206	+ shown = self.main_frame.files_list.shown_data()
	207	+
	208	+ if utils.differ(data, shown):
	209	+ print "Data changed !"
	210	+ self.main_frame.files_list.show(data)
	211	+ footprints.save()
	212	+
	213	+ data = utils.super_entries(
	214	+ self.curr_dir,
	215	+ extensions,
	216	+ ready,
	217	+ footprints)
	218	+
	219	+ shown = self.main_frame.super_files_list.shown_data()
	220	+
	221	+ if utils.differ(data, shown):
	222	+ print "Data changed !"
	223	+ self.main_frame.super_files_list.show(data)
	224	+
	225	+ footprints.save()
	226	+
	227	+ def check_stats(self):
	228	+ if not self.begin_conn():
	229	+ return
	230	+
	231	+ def on_end(result):
	232	+ self.end_conn(result)
	233	+
	234	+ logger = LogThread( text_ctrl=self.main_frame.log_ctrl
	235	+ , target=run_check_stats
	236	+ , args=( self.config["login"]
	237	+ , self.config["passwd"]
	238	+ , const.conn_host
	239	+ , const.conn_port
	240	+ , const.conn_cert )
	241	+ , on_end=on_end )
	242	+ logger.start()
	243	+
	244	+# end of class FileManager
	245	+
	246	+if __name__ == "__main__":
	247	+ manager = FileManager(0)
	248	+ manager.MainLoop()
	249	+ manager.refresh_thread.exitFlag = True
...	...

initial

Too many changes to show. Reload with full diff Plain diff Email patch

Too many changes to show.
Reload with full diff Plain diff Email patch