Posts tagged architecture
.NET is not an enterprise application platform (yet)
Dec 12th
…Windows is. If you have been convinced by Microsoft that .NET is an application platform for the enterprise, here is a list of arguments proving that it is not (yet).
- IIS is not an application server. All it provides is serving dynamic web pages and hosting WCF web services.
- AppFabric have not delivered on its promise. Nobody is using workflows so the only widely usable part of it is the distributed cache (which, I must admit, is nice).
- IIS does not allow to host scheduled tasks. For these you have to use Windows Scheduler which operates on OS level.
- IIS does not work well with custom threading models so things like NServiceBus have to be hosted as Windows Services.
- IIS does not have a decent monitoring & management story. You have to use WMI which, again, is an OS level service that does not speak .NET language and is quite cumbersome do use.
Convinced? So here’s a list of things which you, as a developer, can do to fix this problem
- Extend IIS or create a complementary service that can use the same model as IIS (one core process per system + process per application) that would host scheduled tasks and could incorporate custom threading models thus allowing to run things like NServiceBus. TopShelf would be a good starting point.
- Assembly is not longer a good deployment unit — it is too small. Provide a packaging system that would allow to package several assemblies (a functional module) together. Such a module could be easily deployed (and undeployed) from the application server as a whole.
- Create a decent scheduling library. The only one there is, Quartz.NET, is probably one of the oldest .NET open source projects still in use. It desperately needs a replacement that follows today’s design practices.
- Think about how you could contribute to NetMX or come up with a completely new, lightweight, monitoring & management framework.
Having all these things built, it would be quite easy to assemble an open source private cloud infrastructure. The goal would be to have a farm of servers running either Windows or Linux/Mono that can be treated as one logical machine to which I can easily deploy all kinds of components including (but not only)
- web applications (using various MVC frameworks)
- scheduled services
- message consumers (using various frameworks like NServiceBus or MassTransit)
- web services (using, again, variety of frameworks like WCF or OpenRasta)
delivered in easy to use packages.
Events are not an implementation detail
Nov 29th
When listening to many discussion about Domain-Driven Design and Event Sourcing, subjects which I am recently very into, sometimes I have a feeling that events are considered merely a way of persisting aggregates. People tend to discuss benefits events have with regards to storing historical data, having possibility to generate any read model out of events and so on. Reducing event sourcing to such ‘housekeeping’ duties is castrating your architecture.
This point of view is expressed in a way people model their event-based solutions: thinking first about the aggregates and then, within each aggregate, about events they generate. Sometimes the process is even more event-UNcentric when people first implement a command and then start thinking about what event types should be created.
Given the fact that most Event Sourcing practitioners have a background in DDD, we tend to bring our experience from working in data-centric environment to the event-centric world. There is, however, a fundamental difference between these two.
When building a behaviour-oriented DDD solution on top of a data-centric infrastructure (a database) you do your best to hide the database and its schema from the business layer. Over the years we learnt that it is better treated as implementation detail because it does not provide concepts useful to model behaviour. There concepts must be built on top of it. The underlying data layer must not be visible to the outside world because of it’s volatility — it has to change whenever the behaviour it supports needs to change.
On the other hand, when building a similar solution on top of event-centric infrastructure you can (and should) leverage events to model the behaviour. They (not aggregates or anything built on top of them) are the central concept here. Whenever business changes, new event types appear and some old are no longer generated but no event is ever lost. Whatever happened, happened.
Returning to my original thought, in an event-centric solution aggregates should not be treated as first-class citizens. Don’t get me wrong, they are very useful. In a healthy design probably a vast majority of events would be generated via aggregates, but some would not. Aggregates are priceless when it comes to modelling concurrency and to encapsulating business logic.
You may now want to ask a question when should you use aggregates and when not? The answer seems to be simple. Whenever your system needs to respond to some external activity, you just directly inject an event representing what have happened into your system. The idea is, again, whatever happened, happened. You can’t throw concurrency exception at The World saying it is wrong to raise this event right now. You have to humbly acknowledge the fact and record the information. On the other hand, when it is your system who conducted the activity to be communicated by an event, you should use an aggregate to have full control over how and when the event is published.
Have fun building event-centric solutions!
Classic DDD example, renewed
Oct 25th
I’ve spent some time recently renewing my old DDDSample.NET project. I understand that it is the projection of my subjective and uninformed view of Domain-Driven Design, but still I see a value in having some implementation compared to having nothing — it provokes discussion. That’s why I will continue to invest my time in it. If you happen to read this and want to take a look at the code, please remember that is is a sample (as the name suggests), not a guidance. The difference is following: a sample shows how I am doing things while a guidance would show how you are supposed to do things.
Journey through the stack trace
Classic version of DDDSample is a web application with simple UI created with ASP.NET MVC. This is where all starts. I would like to take you on a journey through the stack trace to explain various architectural decisions. Let’s register a new handling event.
NHibernateAmbientSessionManager
The very first class that gets a chance to process the request is NHibernateAmbientSessionManager. It is responsible for creating an ambient NHibernate session that will be bound to the request. After processing the request the session is released. It can be accessed anywhere in the code statically through CurrentSessionContext class. This is a built-in feature of NHibernate.
public void CreateAndBind()
{
CurrentSessionContext.Bind(_sessionFactory.OpenSession());
}
public void UnbindAndDispose()
{
var session = CurrentSessionContext.Unbind(_sessionFactory);
if (session != null)
{
session.Dispose();
}
}
HandlingController
Next is the HandlingController and it’s RegisterHandlingEvent method/action
[AcceptVerbs(HttpVerbs.Post)]
public ActionResult RegisterHandlingEvent(string trackingId, DateTime? completionTime, string location, HandlingEventType type)
{
if (!completionTime.HasValue)
{
ViewData.ModelState.AddModelError("completionTime", @"Event completion date is required and must be a valid date.");
}
if (!ViewData.ModelState.IsValid)
{
AddHandlingLocations();
AddHandlingEventTypes();
return View();
}
_handlingEventFacade.RegisterHandlingEvent(completionTime.Value, trackingId, location, type);
return RedirectToAction("Track", "Tracking", new { trackingId });
}
There’s nothing fancy here, but is shows in a nice way that in this design, the responsibility of a controller is data validation and parsing (mostly done by MVC internals). After ensuring that data conforms to the required format, it is passed to another class which is…
HandlingFacade
This class hides the design of internals of the application from the UI. As far as controllers are concerned, business logic is implemented in façade’s methods. The truth is slightly different, however.
public void RegisterHandlingEvent(DateTime completionTime, string trackingId, string location, HandlingEventType type)
{
var command = new RegisterHandlingEventCommand
{
CompletionTime = completionTime,
TrackingId = trackingId,
OccuranceLocation = location,
Type = type
};
_pipelineFactory.Process(command);
}
All the façade is doing is packing the arguments into a command object and sending this command to the pipeline where it is processed. Why create a separate class instead of putting this method on the controller? I like my controllers to be concerned only by the UI and have only one reason to change.
NHibernateTransactionCommandFilter
Before the command is actually executed, a number of filters are invoked. I use a very simple command pattern implementation I’ve written a few weeks ago for the sole purpose of using in DDDSample. It allows me to define these filters in a nice (again, subjective view) way
public void OnHandling(object command)
{
_ambientSession = CurrentSessionContext.Unbind(_sessionFactory);
_session = _sessionFactory.OpenSession();
_transaction = _session.BeginTransaction();
CurrentSessionContext.Bind(_session);
}
public void OnHandled(object command, object result)
{
CurrentSessionContext.Unbind(_sessionFactory);
_transaction.Commit();
_session.Close();
CurrentSessionContext.Bind(_ambientSession);
}
Before handling a command an aforementioned ambient NHibernate session is unbound from the current context. We are not going to use it while processing the command because we need a clear workplace. We open a new session and a a new transaction. Whatever happens in the command handler, stays in the command handler. After a command succeeds we unbind the session it used and commit the transaction. Then we restore the ambient session so that UI can use it.
Why don’t we just use a transaction on this ambient session? There is a couple of reasons. First, there can be a transaction started before processing the command and we don’t want to take part in it. Second, we want to be absolutely sure we don’t have any entities in the session-level cache. Why? Because we might use some hints to fetch them more efficiently in context of command processing (like for example force eager load on some relations). And last but not least, if command fails we don’t want to break the session UI was using because it may need it for whatever reason after the command processing attempt failed.
The corollary of this is, we don’t want to put any persistent (tracked by NHibernate) into the command. If we allowed this, we could attach it by mistake to this other session and very strange things could happen. The side effect is we can safely serialize commands which allows us, if the need comes, to put our domain model on a separate tier then its client (the web application).
RegisterHandlingEventCommandHandler
When we have the new session and transaction in place it’s time to do the actual work. Here’s how a typical command handler look like
public object Handle(RegisterHandlingEventCommand command)
{
var trackingId = new TrackingId(command.TrackingId);
var cargo = _cargoRepository.Find(trackingId);
var occuranceLocationUnLocode = new UnLocode(command.OccuranceLocation);
var occuranceLocation = _locationRepository.Find(occuranceLocationUnLocode);
var evnt = new HandlingEvent(command.Type, occuranceLocation, DateTime.Now, command.CompletionTime, cargo);
_handlingEventRepository.Store(evnt);
return null;
}
The idea here is to have only one method or constructor invocation on an Aggregate Root in one command. As you can see, command handler’s responsibility is to convert the raw data from the command to the proper Value Objects. The validation of data is performed when constructing VOs. In this case we create a new AR so we first instantiate a new object and then call repository to store it.
HandlingEventRepository
What happens in the repository?
public void Store(HandlingEvent handlingEvent)
{
Session.Save(handlingEvent);
_eventPublisher.Raise(handlingEvent);
}
Two things. First, we save the newly created AR to the command’s session. Then we use an Event Aggregator to publish this AR as an event. I based this approach on Eric Evans’ What I’ve learned about DDD since the book presentation where he explains that in many domains you encounter Aggregate Roots that are immutable. He calls them Events.
CargoWasHandlerEventHandler
The Event Aggregator publishes the event to all interested parties. In our case there is only one
public void Handle(HandlingEvent handlingEvent)
{
handlingEvent.Cargo.DeriveDeliveryProgress(handlingEvent);
}
It calls a method on a Cargo Aggregate Root to notify it about the event. One thing worth notice here is we are doing it synchronously in the sample but our contract does not guarantee synchronicity. We write our event handlers in such a way that they can be executed asynchronously to the transaction that published the event. It is good to have such possibilities open in case we need to scale.
Cargo
This is how we reach the Cargo AR
public virtual void DeriveDeliveryProgress(HandlingEvent lastHandlingEvent)
{
Delivery = Delivery.DerivedFrom(RouteSpecification, Itinerary, lastHandlingEvent);
}
The method looks very simple and it is not a coincidence. In classic DDD we have limited testing options since we can’t set our Entities to proper state easily (as easy in if we use Event Sourcing). That’s why we don’t want to test Entities. We want to test Value Objects because they are immutable and truly persistence ignorant. All we do in an Entity is pass the arguments to a VO and replace the current value with a new one. The probability that we make a bug in this one-liner is small, at least I hope so.
Delivery
Finally we arrived at our destination, the Value Object. Here I won’t include any code as it is quite complex and lengthy. I’ve already said probably the most important thing about VOs in this approach: they are immutable. This property allows us to test them easily. The compromise we are willing to accept in regards to Value Objects is, we expose their state via properties. Because we don’t have Command and Query Responsibility Separation, we use same objects (but remember, fetched via different session) to read and to write.
Summary
I hope you enjoyed this journey through the layers of the onion. Remember that this is just a sample. Most of its features were tested in the field but some combinations of them were not. I am eager to hear what you think about this approach and also to hear about your approach to DDD when size and/or complexity does not justify CQRS.
Renewing DDDSample.Net, iteration 0
Sep 27th
As I promised in one of the previous posts, I am now in process of renewing the DDDSample.Net source code. It’s been quite a while since I published the first version of it. Many technologies have changed and my take on Domain-Driven Design and software architecture also has changed slightly.
First of all, the repo was moved to github. Hurray! In the process of transforming TFS repository into a git one I lost the branch structure. Originally all versions were branched one from another which made updating all samples a little bit easier since (ideally) I had to change only one and then merge this change. With git I am thinking of a slightly different structure. I am pretty sure I can freeze some portions of the solution (like routing engine and most of the UI) and move them to separate repos. Then I can import them as submodules to each of the samples.
At first I just wanted to add new features to the existing samples but when I opened the vanilla version (a port of Java DDDSample) I found out that it is so outdated that it urgently needs to be renewed. The changes I made so far include:
- Upgrading solution to VS2010 format
- Removing the web setup project (I guess nobody used it, ever)
- Switching to NuGet for resolving most of the packages (using don’t commit packages workflow described here by David Ebbo)
- Upgrading some dependencies (like NHibernate) to the newest versions
- Switching from using façade-like classes in application layer to commands and command handlers implemented using brand new tiny LeanCommandUnframework (a separate micro project hosted here on github)
- Switching from Unity 1.2 to Autofac
- Removing dependency on NServiceBus
- Cleaning up the global.asax file
I am now quite happy with the solution. Everything seems to have its place in the architecture. There are some things yet to be clean up such as changing the way command handlers are created but these should be minor fixes. If you have some spare time, please clone the repo and check if you like what I did. And please note that only Vanilla version was updated.
.NET architecture samples
Sep 8th
A Domain-Driven Design sample I created some time ago, DDDSample.Net, is now a little bit rusty. I though it is a good idea to spend some time and make it up to date. It will involve, for sure, moving the project to github because you all know what I thing about TFS version control.
Currently there are 4 major versions of DDDSample solution
- Vanilla (‘by the book’)
- CQRS with two relational databases
- CQRS with event sourcing
- Layered model
I am thinking about dropping the second one as it was more like an experiment, not a final solution. The layered model is an advanced version of vanilla solution witch demonstrates how to structure larger domain models. Another thing I might do is migrate the event sourcing sample to NCQRS. Or maybe I should use EventStore directly? What do you think?
Now the important part. I have some ideas what to implement next and I need your feedback. Help me rate them
- Event driven SOA a’la Udi Dahan. This would be probably an extended version of layered model sample but with slightly different structuring approach (autonomous services instead of layers).
- Vanilla with RavenDB as a data store
- Native CQRS with event sourcing on RavenDB according to this description by Ayende.
If you have some other ideas, post them in the comments. I am also thinking about getting rid of the installer projects. It does not make sense to just install the application in IIS and don’t look at the code. And if you open it, you can run it by hitting F5.



