Skip to content

Middleware for Mongoose.js that adds pagination, sorting, filtering and projection

License

Notifications You must be signed in to change notification settings

react-epfl/mongoose-middleware

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

64 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Mongoose Middleware

Build Status Coverage Status

Features

  • Pagination (start, count and total matching)
  • Filtering (mandatory matches, optional matches and keyword search)
  • Sorting (ascending and descending)
  • Projection (response field filtering)

Install

npm install mongoose-middleware

Then, simply require the library and pass in the instance of the require('mongoose') statement to the initialize method as follows:

var mongoose = require('mongoose');

require('mongoose-middleware').initialize(mongoose);

Optionally configure max documents for pagination:

var mongoose = require('mongoose');

require('mongoose-middleware').initialize({
		maxDocs : 1000
	}, mongoose);

Overview

This project aims to make basic searching, sorting, filtering and projection tasks against documents stored in MongoDB trivial via Mongoose middleware. The middle exposes a set of Mongoose Query object chainable methods for ease and simplicity of use.

The following example shows usage of field projections, mandatory and optional search filters, sorting and pagination.

var
	mongoose = require('mongoose'),
	Schema = mongoose.Schema,
	KittehModel = mongoose.model(
		'kittehs',
		new Schema({
			birthday : { type : Date, default : Date.now },
			features : {
				color : String,
				isFurreh : Boolean
			},
			home : String,
			name : String,
			peePatches : [String]
		})
	);

require('mongoose-middleware').initialize(mongoose);

/*
	Retrieve the name, home and features.color of kittehs that live in Seattle,
	that are named "Hamish" and that are brindle, black or white in color. The results
	should be sorted by birthday in descending order and name in ascending order.
*/
var options = {
	filter : {
		field : ['name', 'home', 'features.color'],
		mandatory : {
			contains : {
				home : 'seattle'
			},
			exact : {
				name : 'Hamish'
			}
		},
		optional : {
			contains : {
				'features.color' : ['brindle', 'black', 'white']
			}
		}
	},
	sort : {
		desc : 'birthday',
		asc : 'name'
	},
	start : 0,
	count : 500
};

KittehModel
	.find()
	.field(options)
	.keyword(options)
	.filter(options)
	.order(options)
	.page(options,
		function (err, kittehs) {
			if (!err) {
				console.log('we haz kittehs!');
				console.log(kittehs);
			} else {
				console.log(err);
			}
		});

Results

The options submitted to the page(options, callback) middleware method are echoed back in the response along with the results of the query and the total count of results matching the specified filters.

{
	options : {
		count : 500,
		filter : {
			field : ['name', 'home', 'features.color'],
			mandatory : {
				contains : {
					'features.color' : ['brindle', 'black', 'white']
				},
				exact : {
					name : 'Hamish'
				}
			},
			optional : {
				contains : {
					home : 'seattle'
				}
			}
		},
		sort : {
			desc : 'birthday',
			asc : 'name'
		},
		start : 0
	},
	results : [ ... ], // the first 500 brindled, black or white kittehs named Hamish in Seattle
	total : 734
}

API

Initialization

The maxDocs property may optionally be specified on initialize to ensure no more than the specified number of documents are ever returned from a query. Please note that this does not affect the ability for the component to return the correct total count of results when using the pagination middleware function.

var mongoose = require('mongoose'),
require('mongoose-middleware').initialize({
		maxDocs : 1000
	}, mongoose);

Projection (Field Filters)

In order specify specific fields from a document in Mongo to be returned, the fields filter may be used.

var options = {
	filters : {
		field : ['name', 'home', 'qualities.demeanor']
	}
};

KittehModel
	.find()
	.field(options)
	.execFind(function (err, results) {
		// work with response...
	});

Alternatively, a single field can be specified (not in an array):

KittehModel
	.find()
	.field({ filters : { field : '_id' } })
	.execFind(callback);

Filters

Filters can be used in three ways: mandatory, optional and keyword searches. Additionally, for mandatory and optional searches, exact, contains and startsWith string pattern matches may be used.

  • exact - Matches the string letter for letter, but is not case sensitive
  • contains - Matches documents where the string exists as a substring of the field (similar to a where field like '%term%' query in a relational datastore)
  • startsWith - Matches documents where field begins with the string supplied (similar to a where field like 'term%' query in a relational datastore)

Mandatory

Mandatory filters require that the document matches the specified search options or they will not be returned.

Optional

Optional searches allow you to specify more than one filter that you would like to match results for. This type of search is great for cases where you need to find documents that either match "this" OR "that". As an example, image you are searching for cats that are either manx, siamese or tabby, you would configure the filter as follows:

var options = {
	filters : {
		optional : {
			exact : {
				breed : ['manx', 'siamese', 'tabby']
			}
		}
	}
};

KittehModel
	.find()
	.filter(options)
	.execFind(function (err, results) {
		// work with response...
	});

Keyword

Keyword searches provide a convenient way to search more than one field with a single string. Additionally, keyword filters work differently from mandatory and optional filters in that they do not support exact, contains or startsWith. Instead the matches look for occurrences in a similar way to contains but with the ability to specify multiple terms in the query.

The following query will search for documents where the name, description or knownAliases contain Heathcliff the Cat. If the name (or description and knownAliases) contains "Cat, the Heathcliff", "the Cat, Heathcliff", "Heathcliff Cat, the" and "the Heathcliff Cat", those results will also be returned.

var options = {
	filters : {
		keyword : {
			fields : ['name', 'description', 'knownAliases'],
			term : 'Heathcliff the Cat'
		}
	}
};

KittehModel
	.find()
	.filter(options)
	.execFind(function (err, results) {
		// work with response...
	});

If you would like to ensure that matches of "Heathcliff the Cat" in that exact format are returned, simply enclose the term in quotes:

var options = {
	filters : {
		keyword : {
			fields : ['name', 'description', 'knownAliases'],
			term : '"Heathcliff the Cat"'
		}
	}
};

Sorting

Sorting, at this point, is fairly basic. All descending sorts will be applied prior to ascending sorts when specifying multiple sorts of each direction.

Descending

var options = {
	sort : {
		desc : ['name', 'description', 'knownAliases']
	}
};

KittehModel
	.find()
	.order(options)
	.execFind(function (err, results) {
		// work with response...
	});

You may also specify a single field (not an array) for both descending and ascending sorts:

var options = {
	sort : {
		desc : 'birthday'
	}
};

Ascending

var options = {
	sort : {
		asc : ['name', 'description', 'knownAliases']
	}
};

KittehModel
	.find()
	.order(options)
	.execFind(function (err, results) {
		// work with response...
	});

You may also specify ascending and descending sorts together:

var options = {
	sort : {
		asc : 'name'
		desc : ['birthday', 'home']
	}
};

Pagination

Pagination is performed by swapping the exec() or execFind() function of Mongoose with page(). Pagination may be specified as follows:

var options = {
	start : 0,
	count : 100
};

KittehModel
	.find()
	.page(options, function (err, results) {
		// work with response...
	});

When using pagination, maxDocs may specified via the initialize() function of the library which will result in no more than that maximum number of documents being returned.

var
	mongoose = require('mongoose'),
	KittehModel = require('./models/kitteh');

require('mongoose-middleware').initialize({ maxDocs : 50 }, mongoose);

var options = {
	start : 0,
	count : 100
};

KittehModel
	.find()
	.page(options, function (err, results) {
		// results.options.count === 50
	});

Please note: While the maxDocs will limit the number of returned documents, it will not affect the total count value of matching documents.

Response

Pagination returns the specified start, count and overall total numer of matching documents as a wrapper to the results from Mongo.

{
	options : {
		count : 50,
		start : 0
	},
	results : [ ... ],
	total : 734
}

License

MIT Style

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated
documentation files (the "Software"), to deal in the Software without restriction, including without limitation
the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software,
and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions
of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED
TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL
THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF
CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS
IN THE SOFTWARE.

About

Middleware for Mongoose.js that adds pagination, sorting, filtering and projection

Resources

License

Stars

Watchers

Forks

Packages

No packages published