Re: Misleading experiments results



On Jun 19, 4:41 am, gadolin <t...@xxxxxxxxxxx> wrote:
I am having problem with experimental results.

I am analysing algorithm performance, which has random nature.
Since its for security application the more random the better, which
will hide small dependencies under.

What i do is comparison its structure(it results in directed graph with
each vertex having one outer edge) to random mapping.

Now run tests, and look for graphs with number of vertex 128,
create random mapping graph, and graph for my algorithm and checks
number of cycles of different length and so, the number of different
graph is 128^128, what is my problem know that for number of test T=10000,
the results for both doesn't converge and oscillate.

Could you tell me how many test need to be run to get more convergenous
results? or point some source where such info can be got.

Are you sure you generate 10000 _independent_ random graphs? Which
particular parts of the results do not converge? Perhaps you looking
at some extreme percentile?

Aniko
.



Relevant Pages

  • Misleading experiments results
    ... I am analysing algorithm performance, ... Since its for security application the more random the better, ... each vertex having one outer edge) to random mapping. ... create random mapping graph, and graph for my algorithm and checks ...
    (sci.stat.edu)
  • Misleading experiments results
    ... I am analysing algorithm performance, ... Since its for security application the more random the better, ... each vertex having one outer edge) to random mapping. ... create random mapping graph, and graph for my algorithm and checks ...
    (sci.stat.edu)
  • tl.eggdeps 0.2.1
    ... The eggdeps tool reports dependencies between eggs in the working set. ... Dependencies are considered recursively, creating a directed graph. ... Nodes correspond exactly to the distributions in the working set. ...
    (comp.lang.python.announce)
  • gnome package dependency graph
    ... I recall once seeing a graph of the dependencies between GNOME ... or GTK libraries, but didn't find it this time. ...
    (GNOME)
  • terminology q. regarding FK
    ... graph representing FK dependencies and then traversing the ...
    (comp.databases.oracle.misc)