export filename.dsv->dataframe in the right place.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

macro is about dataframes, not import.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

tests moved into LISTOFLIST package.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

filename->dataframe becomes filename.dsv->dataframe and is moved into the API.  Not exported yet.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

listoflist is elsewhere.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

typo in package name

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

use new LISTOFLIST api for sublists-of-same-size-p
use LISTOFLIST in packages.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

we need to depend on the LISTOFLIST package.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

docstring edit, and make a dummy store slot for dataframe-likes.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

filename->dataframe : parse first line as variable names only if flagged. implementation though -- if the first 2 lines are different types and the first line is strings, then guess it's a list of strings of variable names.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

cleaned up code to load dataframes from DSV files, added cls-user as a test package.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

infrastructure for checking out other packages for inclusion.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

since we factored out and rationalized the listoflist transformation functions into their own package, we need to fix the examples to get them to work, now.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

playing with graphics and docs systems.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

old lispstat config variable names changed to cls- names.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

remove cybertiggyr, not trustable.  clean up load, automagically.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

clean up config, now CLS special vars, not LISP-STAT

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

start  for data class structure.  Needs for more work.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

closer to statistical use.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

getting dataframe philosophy right, finally!  added initial data structure for observations, and comments/documentation for how it should all fit together.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

more enablers for test-loading.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

basic structure of the object model for statistical procedures

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

here's what we currently require.  Sigh.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

more stat var stuff, no more cxls stuff.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

factored out xls compat for data stuff.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

lla and xarray TODO's coming up...

better choice of ignored files (LaTeX droppings).

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

realign talks and papers.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

more fleshing out the classes.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

report describing the philosophy we are trying to convey.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

working through the statistical procedures structure.  Unlike R, any new statistical procedure will have to be fit into the structure so to provide the additional needed characterizations.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

forgot that we've migrated listoflist elsewhere, leaving the mappings to/from dataframe-like objects here.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

Talk at Academia Sinica

migrate all listoflist support with matrix/array/dataframe type objects to the resulting types, and any core support into xarray.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

clean up documentation for dataframes.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

need to document package structure somewhere -- it's in Docs, but it might be better in the actual file.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

Template fixed, and license applied to the dataframe unittests.

started to clean up LICENSING.   Need to consider whether to use MIT or GPLv3.  The disadvantage of the GPL is that it scares people off.  The disadvantage of not using it is that it could lead to academic challenges later (i.e. ARC/LispStat issues).

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

use conversion to get CSV into an array.  More processing needed.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

clean up and document examples.  At stage of showing how to load data.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

clean up the CL-VARIATES example to show what the results should be and how to load it.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

make sure we put the dataframes into the dataframe pacakage.  Whoops.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

smaller X11 frame to accomodate my netbook.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

examples for using CL-VARIATES.  Looks really good, EXCEPT FOR THE FRIGGING LICENSE!

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

clean up, checkpointing.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

improving the description of how to do "NA" in CL.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

and loading the new dataframe structure!

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

dataframe refactoring into core and storage-specific components.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

final version presented.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

cleaning up work supporting xarray changes.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

docs/ideas but no code for missing data.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

working through an R-based example to verify things work.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

talk materials.

file for Vanderbilt talk

Rice U and DSC talks, binary versions, sorry Mirko for not adding sooner.

clean up dataframe/xarray mappings.  More to do.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

list-of-list packaging mods

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

moved listoflist infrastructure into xarray as another array-able structure.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

more xarray experiments.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

remove experiment -- we use xarray package for all referencing.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

class for nominal / ordinal variables.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

factored duplicate structure/code from data into import, and made import work again.  This required support mods in defsys.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

silly file, non-sensical but well intentioned.

code to check the new xref approach.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

use xref approach for CLS.  (need to do so for lisp-matrix as well.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

moving from older dfref to the generic xref approach.  One less key stroke to use .
Need to add test cases.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

initialization cleanup

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

handling the lisp-matrix / xarray slice problem, by preferring the xarray simplified view.  We will have to consider renaming lisp-matrix's slice to generalized-slice or similar.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

initial doc for why/what dataframes are in CLS.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

clean up docstrings and coding style.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

support for use of native lisp arrays as matrices.  semi-useful.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

clean up statistical descriptive generics.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

cleanup loading function.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

move guidance code examples into documentation and clean up current TODO tasks.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

directories should be FASL-SYSTEM, not SYSTEM-FASL.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

another task covered already in ditz.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

Remove CL-PDF/CL-TYPESETTING, solved and merged issues into patched version.
comment out sig/args manipulation.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

data refactoring -- creation and activities related to package restructuring.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

macro problem -- code was out of quote, fixed.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

doc query.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

use CLS instead of LISPSTAT

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

better logic for DEF.
documentation

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

documentation , but needs to be moved into ditz.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

Use CLS instead of LispStat to describe this system.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

docs and dataframe-listoflist structures, and use of new listoflist dispatched methods.
increasing xarray integration.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

xarray setup, progress.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

handle the shadowing from CLS explicitly (setup to use CLS dataframes and lisp-matrix matrices).

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

basic rectangular structure data construction

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

README is not valid -- add comment at top

better docs.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

proposed efficiency -- requires that only xref'able storage be used.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

David Henderson caught this during todays demo, Thanks Dave!

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

clean up errors, introduce a few things to implement.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

get rid of cybertyggr, in favor of rsm-strings.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

documentation and preparation for statistical-oriented access and views.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

nothing to see here, yet, but should migrate code out of ls-demo soon.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

Might be final version.  Need to sleep on it.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

remind self to consider packaging to avoid namespace pollution.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

add config variables to :cls package, since we will need them.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>

remove csv-data, since we are using the rsm-string package.

Signed-off-by: AJ Rossini <blindglobe@gmail.com>