Giter VIP home page Giter VIP logo

homework-eval's Introduction

TODO


Problem Configuration
---------------------

Each problems has a list of properties which are read from the files
  problems/config
  problems/PBNAME/config
The format of these files is whatever java.util.Properties.load says. Roughly,
it's a list of lines of the form
  KEY VALUE
The settings in problems/PBNAME/config override those in problems/config.

The following keys should be defined:
  KEY             EXAMPLE           DESCRIPTION
  name            HardOne           the problem name
  penalty         23                each bad submission adds 23 minutes of penalty
  points          10                solving this problem is worth 10 points
  memlimit        100               impose a space limit of 100 megabytes
  timelimit       10                impose a time limit of 10 seconds
  deadline        2014-02-05 16:00  hide problem after this time
  start           2014-02-01 10:00  hide problem before this time
  scoringmethod   proportional      you earn point x (fraction of solved tests)
                  binary            either you earn all points or none
  validator       builtin           compare files word by word, alowing small errors if the words could be parsed as Double
                  anything-else     run "anything-else output reference-output"; zero exit code means OK
  difficulty      4                 used to sort problems when displaying them in browser

Language Configuration
----------------------

The file languages/LANG contains the configuration for language LANG. The
format of theses files is as above. But, the keys are

  KEY         EXAMPLE         DESCRIPTION
  save        PB.java         where to save the submitted source code
  compile     javac PB.java   how to compile the code
  executable  PB.class        consider compilation successful iff this file exists
  run         java PB         how to run the executable

In all cases, PB will be substituted with the problem name (see key "name" in
Problem Configuration).


Global Configuration
--------------------

Some options aren't specific to a problem or a language. These are stored in
  config

The keys are

  KEY           EXAMPLE           DESCRIPTION
  totalpoints   100               should be the sum of all problem points (to deprecate, I think)
  scorefreeze   2014-02-05 15:30  hide scoreboard after this time

homework-eval's People

Contributors

pauloboliva avatar rgrig avatar

Watchers

 avatar  avatar

homework-eval's Issues

fix style

Use GWT's recommendations.
Make sure it looks nice.

Original issue reported on code.google.com by [email protected] on 26 Jan 2011 at 10:13

login ui

1. Focus should be initially on the 'psudonym' box.
2. Enter in the password box (and in the pseudonym box?) should behave like 
clicking Login. Perhaps I should even ditch the login button.

Original issue reported on code.google.com by [email protected] on 21 Jan 2011 at 2:18

timeout

1. Make the session last for more. (I think this means use a cookie instead of 
HTTP sessions.)

2. If the session expires and a solution is submitted, then give a good error 
message, not the current "does not compile."

Original issue reported on code.google.com by [email protected] on 24 Jan 2011 at 9:03

sort tasks

Tasks are presented in some random order.
They should be in some definite order.
The easy ones should come first (add "difficulty" as a task property).
Then use some tie-breaker, perhaps deadline followed by task id.

Original issue reported on code.google.com by [email protected] on 25 Jan 2011 at 6:08

quizzes

Either remove everything related to quizzes, or check their code and clean it 
up.

I seldom use quizzes, so I think it's not worth maintaining.

Original issue reported on code.google.com by [email protected] on 25 Jan 2011 at 6:45

ui: colors

The colors are a bit messed up and certain things are hard to read. For 
example, the title of the dialog that appears after submitting a problem.

Original issue reported on code.google.com by [email protected] on 25 Jan 2011 at 6:05

support acm icpc scoring style

This uses time penalty as a tie breaker.

The penalty for a problem is the time it took to solve (in minutes) plus a 
constant penalty for each wrong submission.

Original issue reported on code.google.com by [email protected] on 21 Jan 2011 at 1:53

sync with server

Changes to the configuration are seen by clients only after logging-in again. 
They should either:
(1) poll the server for changes, or
(2) get a ping from the server when something changed.

Original issue reported on code.google.com by [email protected] on 6 Feb 2012 at 2:33

all-or-nothing scoring

Introduce different scoring methods, proportional and binary.  The current 
behaviour would be reproduced by adding
  scoring proportional
to the main config file.

Original issue reported on code.google.com by [email protected] on 26 Jan 2012 at 7:12

configurable validator

It should be possible to use an external program as a validator.  That would 
allow, for example, tasks with more than one correct answer, or even 
optimization tasks.

Original issue reported on code.google.com by [email protected] on 6 Feb 2012 at 2:38

configurable title

Since this software is supposed to be used for various purposes, it should be 
easy to configure he title of the site. And perhaps allow some other kind of 
branding.

Original issue reported on code.google.com by [email protected] on 25 Jan 2011 at 6:06

better time tracking

I believe the "submission time" recorded now is really the time when judging 
starts, after perhaps staying a bit in a queue. Since penalties are used for 
ranking, this should be fixed.

Original issue reported on code.google.com by [email protected] on 25 Jan 2011 at 7:14

better submission feedback

The dialog that appears after submitting must say clearly what was the result 
of the evaluation.

It should distinguish between WA and LE, in a way that fits with multiple tests.

Original issue reported on code.google.com by [email protected] on 25 Jan 2011 at 6:04

debian package

Setting up should be automated in a script.
That script should be put in a debian package.
There should be a target in build.xml that produces the .deb file.

Original issue reported on code.google.com by [email protected] on 21 Jan 2011 at 3:44

ui: dialogs

Use Window.alert ONLY to diagnose bugs in the judge.
Otherwise avoid, because it freezes the whole browser, which is annoying.

Original issue reported on code.google.com by [email protected] on 25 Jan 2011 at 6:38

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.